[ 566.698562] env[69559]: INFO neutron.common.config [-] Logging enabled! [ 566.698884] env[69559]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 26.0.0.0rc2.dev49 [ 566.698992] env[69559]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69559) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 566.699300] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 566.699397] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 566.700221] env[69559]: WARNING oslo_policy.policy [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 566.700439] env[69559]: WARNING oslo_policy.policy [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 566.703017] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] VMware NSXv3 Agent initialized successfully. [ 566.703017] env[69559]: DEBUG oslo_concurrency.lockutils [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] Acquiring lock "singleton_lock" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.703017] env[69559]: DEBUG oslo_concurrency.lockutils [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] Acquired lock "singleton_lock" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.703017] env[69559]: DEBUG oslo_concurrency.lockutils [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] Releasing lock "singleton_lock" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.703017] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] Full set of CONF: {{(pid=69559) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 566.703207] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ******************************************************************************** {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 566.703207] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] Configuration options gathered from: {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 566.703479] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 566.703659] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 566.703773] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ================================================================================ {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 566.703945] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] agent_down_time = 75 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.704104] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] allow_automatic_dhcp_failover = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.704247] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] allow_bulk = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.704393] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] api_extensions_path = {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.706308] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] api_paste_config = api-paste.ini {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.706308] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] auth_strategy = keystone {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.706308] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] backdoor_port = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.706308] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] backdoor_socket = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.706308] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] backlog = 4096 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.706308] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] base_mac = fa:16:3e:00:00:00 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.706308] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] bind_host = 0.0.0.0 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.706670] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] bind_port = 9696 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.706670] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] client_socket_timeout = 900 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.706670] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] config_dir = [] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.706670] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.706670] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] config_source = [] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.706670] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] control_exchange = neutron {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.706960] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] core_plugin = ml2 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.706960] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] debug = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.706960] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] default_availability_zones = [] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.706960] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.706960] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] dhcp_agent_notification = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.707132] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] dhcp_agents_per_network = 1 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.707383] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] dhcp_lease_duration = 86400 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.707467] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] dhcp_load_type = networks {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.707560] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] dns_domain = openstacklocal {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.707705] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.707845] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] enable_default_route_bfd = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.707982] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] enable_default_route_ecmp = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.708135] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] enable_dvr = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.708273] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] enable_new_agents = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.708408] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.708546] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] enable_signals = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.708682] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] enable_traditional_dhcp = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.708818] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] external_dns_driver = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.708954] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] filter_validation = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.709112] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] global_physnet_mtu = 8950 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.709256] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] graceful_shutdown_timeout = 60 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.709436] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] host = cpu-1 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.709583] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] host_dvr_for_dhcp = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.709724] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] http_retries = 3 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.709870] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] instance_format = [instance: %(uuid)s] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.710022] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.710171] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ipam_driver = internal {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.710312] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ipv6_pd_enabled = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.710454] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] l3_ha = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.710598] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.710761] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] l3_ha_network_physical_name = {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.710946] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] l3_ha_network_type = {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.711425] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] log_color = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.711425] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] log_config_append = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.711425] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.711425] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] log_dir = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.711586] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] log_file = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.711667] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] log_options = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.711809] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] log_rotate_interval = 1 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.711954] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] log_rotate_interval_type = days {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.712113] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] log_rotation_type = none {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.712226] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.712335] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.712480] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.712624] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.712736] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.712877] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] max_dns_nameservers = 5 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.713028] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] max_header_line = 16384 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.713174] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] max_l3_agents_per_router = 3 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.713310] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] max_logfile_count = 30 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.713446] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] max_logfile_size_mb = 200 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.713582] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] max_subnet_host_routes = 20 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.713724] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] my_ip = 10.180.1.21 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.713866] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] my_ipv6 = ::1 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.714022] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] network_auto_schedule = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.714175] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] network_link_prefix = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.714326] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.714603] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] notify_nova_on_port_data_changes = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.714603] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] notify_nova_on_port_status_changes = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.714747] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] pagination_max_limit = -1 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.714886] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] publish_errors = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.715158] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] rate_limit_burst = 0 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.715247] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] rate_limit_except_level = CRITICAL {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.716295] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] rate_limit_interval = 0 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.716295] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] retry_until_window = 30 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.716295] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] router_distributed = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.716295] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] rpc_resources_processing_step = 20 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.716295] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] rpc_response_max_timeout = 600 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.716295] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] rpc_response_timeout = 60 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.716295] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] send_events_interval = 2 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.716548] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] service_plugins = ['router'] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.716548] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] setproctitle = on {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.716604] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] shell_completion = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.716769] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] state_path = /opt/stack/data/neutron {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.716845] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] syslog_log_facility = LOG_USER {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.716982] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] tcp_keepidle = 600 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.717529] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] transport_url = **** {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.717529] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] use_journal = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.717529] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] use_json = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.717842] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] use_ssl = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.717842] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] use_stderr = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.717842] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] use_syslog = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.718309] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] vlan_qinq = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.718309] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] vlan_transparent = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.718309] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] watch_log_file = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.719690] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] wsgi_default_pool_size = 100 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.719690] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] wsgi_keep_alive = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.719690] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.719690] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] wsgi_server_debug = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 566.719690] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_concurrency.disable_process_locking = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.719690] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.719905] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.719905] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.719905] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.719905] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.719905] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.719905] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] profiler.connection_string = messaging:// {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.720102] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] profiler.enabled = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.720238] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] profiler.es_doc_type = notification {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.720326] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] profiler.es_scroll_size = 10000 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.720468] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] profiler.es_scroll_time = 2m {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.720636] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] profiler.filter_error_trace = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.720983] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] profiler.hmac_keys = **** {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.720983] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] profiler.sentinel_service_name = mymaster {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.721436] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] profiler.socket_timeout = 0.1 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.721436] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] profiler.trace_requests = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.721436] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] profiler.trace_sqlalchemy = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.721436] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] profiler_jaeger.process_tags = {} {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.721630] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] profiler_jaeger.service_name_prefix = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.721705] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] profiler_otlp.service_name_prefix = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.722122] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_policy.enforce_new_defaults = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.722122] env[69559]: WARNING oslo_config.cfg [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 566.722426] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_policy.enforce_scope = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.722426] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_policy.policy_default_rule = default {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.722988] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.722988] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.722988] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.722988] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.723149] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.723330] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.723330] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.723330] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_policy.remote_timeout = 60.0 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.723330] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.723330] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] agent.extensions = [] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.723330] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.724541] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] service_providers.service_provider = [] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.724541] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] QUOTAS.default_quota = -1 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.724541] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.724674] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] QUOTAS.quota_floatingip = 50 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.724720] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] QUOTAS.quota_network = 100 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.725766] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] QUOTAS.quota_port = 500 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.725766] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.725766] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] QUOTAS.quota_router = 10 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.725766] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] QUOTAS.quota_security_group = 10 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.725766] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.725766] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] QUOTAS.quota_subnet = 100 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.725766] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] QUOTAS.track_quota_usage = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.726019] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.726019] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep.group = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.726158] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep.helper_command = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.726260] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.726401] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep.thread_pool_size = 8 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.726534] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep.user = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.726678] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.727222] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_dhcp_release.group = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.727222] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_dhcp_release.helper_command = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.727222] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.727328] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.727404] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_dhcp_release.user = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.727615] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.727700] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_ovs_vsctl.group = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.727851] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_ovs_vsctl.helper_command = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.728797] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.728797] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.728797] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_ovs_vsctl.user = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.728797] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_namespace.capabilities = [21] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.728797] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_namespace.group = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.728797] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_namespace.helper_command = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.728797] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.729039] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_namespace.thread_pool_size = 8 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.729039] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_namespace.user = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.729213] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_conntrack.capabilities = [12] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.729303] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_conntrack.group = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.729436] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_conntrack.helper_command = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.729577] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.729712] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.729845] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_conntrack.user = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.730361] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_link.capabilities = [12, 21] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.730361] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_link.group = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.730361] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_link.helper_command = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.730536] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.730536] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_link.thread_pool_size = 8 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.730650] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] privsep_link.user = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.731164] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.731164] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.731164] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT.continue_on_failed_promotions = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.731288] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT.dscp = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.731365] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT.dscp_inherit = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.731536] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT.force_mp_to_policy = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.731662] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT.locking_coordinator_url = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.732352] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT.log_agent_heartbeats = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.732352] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT.logging_expire = 1 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.732352] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.732352] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.732352] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT.polling_interval = 240 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.732563] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.732633] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.732756] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT.report_interval = 30.0 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.732898] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.733050] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.733195] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.733510] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT.sync_skew = 60 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.733510] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT.synchronization_queue_size = 20 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.735886] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT.use_helper_for_ns_read = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.735886] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] SECURITYGROUP.enable_ipset = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.735886] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] SECURITYGROUP.enable_security_group = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.735886] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.735886] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.735886] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] experimental.ipv6_pd_enabled = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.735886] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ml2.extension_drivers = ['port_security'] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.736131] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ml2.external_network_type = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.736131] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.736131] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ml2.overlay_ip_version = 4 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.736131] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ml2.path_mtu = 8950 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.736131] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ml2.physical_network_mtus = {} {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.736131] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ml2.tenant_network_types = ['vlan'] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.736131] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.736305] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ml2.type_drivers = ['vlan'] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.736305] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT_CLI.neutron_port_id = [] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.736305] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.736305] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.736305] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.736427] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.736581] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.736822] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.736822] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.736962] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.737192] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.737348] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_login_password = **** {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.737496] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_login_port = 443 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.737639] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_login_user = admin {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.738399] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.738399] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.738399] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.738399] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.738399] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.738697] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.738697] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.738789] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.738936] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.739095] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.739250] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.739392] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.739546] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.739733] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.739883] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] vsphere.vsphere_login_password = VMware1! {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.740043] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.740271] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.740361] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] nova.auth_section = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.740483] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] nova.auth_type = password {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.740630] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.740769] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] nova.certfile = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.740910] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] nova.collect_timing = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.741080] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] nova.endpoint_type = public {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.741226] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] nova.insecure = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.741365] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] nova.keyfile = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.741515] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] nova.region_name = RegionOne {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.741657] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] nova.split_loggers = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.741799] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] nova.timeout = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.741941] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] placement.auth_section = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.742102] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] placement.auth_type = password {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.742252] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.742388] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] placement.certfile = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.742589] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] placement.collect_timing = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.742673] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] placement.endpoint_type = public {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.742806] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] placement.insecure = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.742942] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] placement.keyfile = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.743088] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] placement.region_name = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.743396] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] placement.split_loggers = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.743396] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] placement.timeout = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.743542] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.auth_section = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.743631] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.auth_type = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.743769] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.cafile = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.743908] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.certfile = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.744082] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.collect_timing = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.744241] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.connect_retries = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.744384] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.connect_retry_delay = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.744527] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.enable_notifications = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.744661] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.endpoint_override = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.744805] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.insecure = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.744945] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.interface = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.745242] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.keyfile = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.745242] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.max_version = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.745382] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.min_version = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.745490] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.region_name = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.745629] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.retriable_status_codes = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.745763] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.service_name = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.745897] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.service_type = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.746071] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.split_loggers = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.746225] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.status_code_retries = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.746367] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.status_code_retry_delay = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.746836] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.timeout = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.746836] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.valid_interfaces = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.746836] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ironic.version = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.747059] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] cli_script.dry_run = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.747110] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.747249] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.747395] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.747539] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.747678] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.747818] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.747956] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.748110] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.748255] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.748411] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.748550] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.748696] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.748838] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.748979] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.749129] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.749279] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.749419] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.749560] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.749704] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.749843] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.749981] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.750136] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.750378] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.750446] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.750544] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.750681] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.750818] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.751060] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.751127] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.751235] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.751375] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.ssl = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.751522] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.751663] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.751802] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.751950] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.752108] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.ssl_version = {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.752261] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.752449] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_notifications.driver = [] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.752542] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_notifications.retry = -1 {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.752694] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.752833] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] oslo_messaging_notifications.transport_url = **** {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 566.752945] env[69559]: DEBUG oslo_service.backend.eventlet.service [None req-448d83e1-c438-42ea-9955-f6ec50041559 None None] ******************************************************************************** {{(pid=69559) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 566.753916] env[69559]: DEBUG neutron.agent.securitygroups_rpc [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Init firewall settings (driver=nsxv3) {{(pid=69559) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 566.755199] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69559) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 566.755432] env[69559]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] RPC agent_id: nsxm-l-01a.corp.local [ 566.757650] env[69559]: DEBUG dogpile.cache.region [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 566.757774] env[69559]: DEBUG dogpile.lock [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 566.757874] env[69559]: DEBUG dogpile.lock [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 566.757967] env[69559]: DEBUG dogpile.lock [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 566.758075] env[69559]: DEBUG dogpile.cache.region [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 566.758167] env[69559]: DEBUG dogpile.lock [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 566.758291] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 566.775240] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Session token - acquiring [ 566.776717] env[69559]: DEBUG networking_nsxv3.common.locking [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.776885] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.776998] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.777423] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.787133] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.056822] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 567.076970] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 567.077143] env[69559]: DEBUG dogpile.cache.region [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Cache value generated in 0.319 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 567.077263] env[69559]: DEBUG dogpile.lock [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 567.077385] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Activating Policy API Provider. [ 567.077577] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Looking for the default Infrastructure Rules. [ 567.136713] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Looking for the Default Layer3 Logged Drop Section. [ 567.149176] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 567.149589] env[69559]: DEBUG networking_nsxv3.common.locking [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.149757] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquiring lock "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.149863] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquired lock "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.150183] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquired external semaphore "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.150518] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.665133] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.168604] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.671364] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Inventory metadata is going to be refreshed. [ 568.671533] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 569.448288] env[69559]: DEBUG networking_nsxv3.common.locking [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.448749] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.448749] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.448913] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.460483] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 569.568239] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.569198] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 569.586806] env[69559]: DEBUG networking_nsxv3.common.locking [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.587179] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.587179] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.587446] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.587618] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.587728] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 569.587848] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 569.587955] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 569.605872] env[69559]: DEBUG networking_nsxv3.common.locking [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.606124] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.606198] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.606465] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.606636] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.606776] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 569.624230] env[69559]: DEBUG networking_nsxv3.common.locking [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.624445] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.624512] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.624749] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.624887] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.625042] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 569.644259] env[69559]: DEBUG networking_nsxv3.common.locking [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.644518] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquiring lock "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.644580] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquired lock "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.644816] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquired external semaphore "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.644955] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Releasing lock "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.645119] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 569.645229] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 569.645334] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 569.660487] env[69559]: DEBUG networking_nsxv3.common.locking [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.660660] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquiring lock "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.660733] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquired lock "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.660973] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquired external semaphore "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.661107] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Releasing lock "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.661241] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 569.661346] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 569.661448] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 569.680902] env[69559]: DEBUG networking_nsxv3.common.locking [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.681096] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.681159] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.681401] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.681536] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.681678] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 569.681785] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 569.681888] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Inventory metadata have been refreshed. [ 569.681990] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Dryrun:True. Metadata refresh completed. [ 569.682117] env[69559]: DEBUG oslo_concurrency.lockutils [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Releasing lock "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.683697] env[69559]: INFO neutron.agent.agent_extensions_manager [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Loaded agent extensions: [] [ 569.685036] env[69559]: DEBUG neutron_lib.callbacks.manager [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69559) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 569.730829] env[69559]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] NSXv3 Agent Agent RPC Daemon Started! [ 569.730977] env[69559]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] NSXv3 Agent Agent loop - iteration:0 started [ 569.731052] env[69559]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] NSXv3 Agent Agent out of sync with plugin! [ 574.686473] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 574.686473] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 579.687320] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 579.687642] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 583.603815] env[69559]: INFO networking_nsxv3.common.synchronization [None req-50c599e5-2a6a-429b-9762-2a9574209fac demo admin] Enqueued Resource ID: fb408548-8d78-4e84-98e3-16717b6d2c32 with Priority: HIGHEST for action security_group_rules [ 583.603815] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb408548-8d78-4e84-98e3-16717b6d2c32 with Priority: HIGHEST for action security_group_rules [ 583.604136] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb408548-8d78-4e84-98e3-16717b6d2c32 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.604136] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb408548-8d78-4e84-98e3-16717b6d2c32" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.604241] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb408548-8d78-4e84-98e3-16717b6d2c32" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.605024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb408548-8d78-4e84-98e3-16717b6d2c32" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.605024] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb408548-8d78-4e84-98e3-16717b6d2c32',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.198121] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.198400] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.198400] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.198631] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.198728] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.198825] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb408548-8d78-4e84-98e3-16717b6d2c32 already deleted. [ 584.198825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb408548-8d78-4e84-98e3-16717b6d2c32" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.688118] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.688608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.688703] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.688886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.689122] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.191134] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.693048] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.194931] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 586.195110] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 586.879664] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.880178] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.880178] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.880178] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.891695] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 586.892458] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.893058] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 586.908856] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.909022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.909067] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.909239] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.909321] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.909419] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 586.909491] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 586.909559] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 586.926491] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.926645] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.926707] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.926816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.926936] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.927042] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 586.944425] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.944656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.944656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.944770] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.944865] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.944960] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 586.962785] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.962908] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.962980] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.963144] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.963234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.963334] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 586.963409] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 586.963518] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 586.978953] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.979105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.979145] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.979300] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.979379] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.979470] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 586.979541] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 586.979607] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 586.997687] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.997809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.997848] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.998013] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.998107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.998206] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 586.998279] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 586.998343] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 586.998406] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 586.998478] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 586.998558] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 586.998631] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 586.998873] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 586.998936] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 586.999010] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 587.016184] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.016320] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.016391] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.016545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.016638] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.016733] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 587.031989] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.032153] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.032208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.032337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.032430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.045868] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.605044] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 588.605389] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 593.606562] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 593.606898] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 598.608259] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 598.608689] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 603.609928] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 603.611293] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 607.724232] env[69559]: INFO networking_nsxv3.common.synchronization [None req-46d18d46-4ce6-4bf9-bc2a-69181d8fa4fb None None] Enqueued Resource ID: cfb79cbb-a233-465c-b87e-bf2e71d479b3 with Priority: HIGHEST for action port [ 607.725111] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfb79cbb-a233-465c-b87e-bf2e71d479b3 with Priority: HIGHEST for action port [ 607.725111] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfb79cbb-a233-465c-b87e-bf2e71d479b3 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.725290] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfb79cbb-a233-465c-b87e-bf2e71d479b3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.725290] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfb79cbb-a233-465c-b87e-bf2e71d479b3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.726107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfb79cbb-a233-465c-b87e-bf2e71d479b3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.726107] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfb79cbb-a233-465c-b87e-bf2e71d479b3',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.229490] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cfb79cbb-a233-465c-b87e-bf2e71d479b3 [ 608.229734] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.230066] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.230066] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.230178] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.230228] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.230306] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cfb79cbb-a233-465c-b87e-bf2e71d479b3 already deleted. [ 608.230386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfb79cbb-a233-465c-b87e-bf2e71d479b3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.541639] env[69559]: INFO networking_nsxv3.common.synchronization [None req-c74b5e7d-3ab9-429e-9710-cacde1aae6d9 None None] Enqueued Resource ID: 0c1f7949-1b07-4f34-a51e-80f067def687 with Priority: HIGHEST for action port [ 609.541961] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c1f7949-1b07-4f34-a51e-80f067def687 with Priority: HIGHEST for action port [ 609.542465] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c1f7949-1b07-4f34-a51e-80f067def687 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.542590] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c1f7949-1b07-4f34-a51e-80f067def687" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.542646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c1f7949-1b07-4f34-a51e-80f067def687" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.542884] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c1f7949-1b07-4f34-a51e-80f067def687" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.542966] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c1f7949-1b07-4f34-a51e-80f067def687',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.048175] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c1f7949-1b07-4f34-a51e-80f067def687 [ 610.048561] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.048750] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.048800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.048994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.049099] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.049195] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c1f7949-1b07-4f34-a51e-80f067def687 already deleted. [ 610.049274] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c1f7949-1b07-4f34-a51e-80f067def687" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.395172] env[69559]: INFO networking_nsxv3.common.synchronization [None req-0941f162-e8dc-490f-a0ae-df01f2d0d100 None None] Enqueued Resource ID: 4fc4758c-e8e4-45d3-9700-476758a736fe with Priority: HIGHEST for action port [ 612.395172] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fc4758c-e8e4-45d3-9700-476758a736fe with Priority: HIGHEST for action port [ 612.395172] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fc4758c-e8e4-45d3-9700-476758a736fe taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.395172] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fc4758c-e8e4-45d3-9700-476758a736fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.395172] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fc4758c-e8e4-45d3-9700-476758a736fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.395949] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fc4758c-e8e4-45d3-9700-476758a736fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.396152] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fc4758c-e8e4-45d3-9700-476758a736fe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.899266] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4fc4758c-e8e4-45d3-9700-476758a736fe [ 612.899479] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.899623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.899623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.899865] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.899950] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.900076] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4fc4758c-e8e4-45d3-9700-476758a736fe already deleted. [ 612.900156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fc4758c-e8e4-45d3-9700-476758a736fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.055766] env[69559]: INFO networking_nsxv3.common.synchronization [None req-0fe290ba-be17-4b66-b36f-09aa49f017ef None None] Enqueued Resource ID: 699c4b74-1b57-48ca-af91-f7298b381f39 with Priority: HIGHEST for action port [ 614.057213] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 699c4b74-1b57-48ca-af91-f7298b381f39 with Priority: HIGHEST for action port [ 614.057325] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-699c4b74-1b57-48ca-af91-f7298b381f39 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.057568] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-699c4b74-1b57-48ca-af91-f7298b381f39" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.057568] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-699c4b74-1b57-48ca-af91-f7298b381f39" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.057757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-699c4b74-1b57-48ca-af91-f7298b381f39" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.057838] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('699c4b74-1b57-48ca-af91-f7298b381f39',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.144022] env[69559]: INFO networking_nsxv3.common.synchronization [None req-3207d2e1-7e9e-4dfd-a963-bb00fcd8a534 None None] Enqueued Resource ID: 019dfe2a-b894-4f1f-af13-ea19458a8462 with Priority: HIGHEST for action port [ 614.144022] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 019dfe2a-b894-4f1f-af13-ea19458a8462 with Priority: HIGHEST for action port [ 614.144022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-019dfe2a-b894-4f1f-af13-ea19458a8462 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.144022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-019dfe2a-b894-4f1f-af13-ea19458a8462" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.144022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-019dfe2a-b894-4f1f-af13-ea19458a8462" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.144022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-019dfe2a-b894-4f1f-af13-ea19458a8462" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.144022] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('019dfe2a-b894-4f1f-af13-ea19458a8462',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.562352] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 699c4b74-1b57-48ca-af91-f7298b381f39 [ 614.562352] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.562352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.562352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.562352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.562352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.562352] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:699c4b74-1b57-48ca-af91-f7298b381f39 already deleted. [ 614.562352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-699c4b74-1b57-48ca-af91-f7298b381f39" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.643313] env[69559]: INFO networking_nsxv3.common.synchronization [None req-608800ae-2d63-4a73-8ec8-d689c56e0096 None None] Enqueued Resource ID: d30b93d9-0ede-44f5-b99a-9642d146b6ab with Priority: HIGHEST for action port [ 614.643555] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d30b93d9-0ede-44f5-b99a-9642d146b6ab with Priority: HIGHEST for action port [ 614.644103] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-d30b93d9-0ede-44f5-b99a-9642d146b6ab taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.644223] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d30b93d9-0ede-44f5-b99a-9642d146b6ab" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.648035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d30b93d9-0ede-44f5-b99a-9642d146b6ab" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.648035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d30b93d9-0ede-44f5-b99a-9642d146b6ab" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.648035] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d30b93d9-0ede-44f5-b99a-9642d146b6ab',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.648035] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 019dfe2a-b894-4f1f-af13-ea19458a8462 [ 614.648035] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.648035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.648035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.648035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.648699] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.648699] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:019dfe2a-b894-4f1f-af13-ea19458a8462 already deleted. [ 614.648699] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-019dfe2a-b894-4f1f-af13-ea19458a8462" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.149677] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d30b93d9-0ede-44f5-b99a-9642d146b6ab [ 615.151141] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.151141] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.151141] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.151141] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.151141] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.151141] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d30b93d9-0ede-44f5-b99a-9642d146b6ab already deleted. [ 615.151141] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d30b93d9-0ede-44f5-b99a-9642d146b6ab" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.867798] env[69559]: INFO networking_nsxv3.common.synchronization [None req-74993668-73e0-44fb-a39d-a7ce952047ad None None] Enqueued Resource ID: bb537107-c18a-49b7-bfe8-0ea1d7c1be80 with Priority: HIGHEST for action port [ 615.867798] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb537107-c18a-49b7-bfe8-0ea1d7c1be80 with Priority: HIGHEST for action port [ 615.867798] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb537107-c18a-49b7-bfe8-0ea1d7c1be80 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.867798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb537107-c18a-49b7-bfe8-0ea1d7c1be80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.867798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb537107-c18a-49b7-bfe8-0ea1d7c1be80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.868623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb537107-c18a-49b7-bfe8-0ea1d7c1be80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.868623] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb537107-c18a-49b7-bfe8-0ea1d7c1be80',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.265542] env[69559]: INFO networking_nsxv3.common.synchronization [None req-70a3caa4-c61d-4193-96c2-c4de57a9d325 None None] Enqueued Resource ID: 27d4e34d-fc54-4a20-be49-83f6d4c9d943 with Priority: HIGHEST for action port [ 616.265987] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27d4e34d-fc54-4a20-be49-83f6d4c9d943 with Priority: HIGHEST for action port [ 616.267159] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-27d4e34d-fc54-4a20-be49-83f6d4c9d943 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.267292] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27d4e34d-fc54-4a20-be49-83f6d4c9d943" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.267360] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27d4e34d-fc54-4a20-be49-83f6d4c9d943" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.270144] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27d4e34d-fc54-4a20-be49-83f6d4c9d943" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.270144] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27d4e34d-fc54-4a20-be49-83f6d4c9d943',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.371855] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb537107-c18a-49b7-bfe8-0ea1d7c1be80 [ 616.371855] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.371855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.371855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.371855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.371855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.371855] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb537107-c18a-49b7-bfe8-0ea1d7c1be80 already deleted. [ 616.371855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb537107-c18a-49b7-bfe8-0ea1d7c1be80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.770754] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27d4e34d-fc54-4a20-be49-83f6d4c9d943 [ 616.771088] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.771279] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.771384] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.771664] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.771792] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.771927] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27d4e34d-fc54-4a20-be49-83f6d4c9d943 already deleted. [ 616.772059] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27d4e34d-fc54-4a20-be49-83f6d4c9d943" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.454774] env[69559]: INFO networking_nsxv3.common.synchronization [None req-eb077cbf-0e04-4873-a72e-378649f1e78c None None] Enqueued Resource ID: 918f4ea7-500f-4b21-931f-a0af5ed8d814 with Priority: HIGHEST for action port [ 619.459263] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918f4ea7-500f-4b21-931f-a0af5ed8d814 with Priority: HIGHEST for action port [ 619.459263] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-918f4ea7-500f-4b21-931f-a0af5ed8d814 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.459263] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-918f4ea7-500f-4b21-931f-a0af5ed8d814" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.459263] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-918f4ea7-500f-4b21-931f-a0af5ed8d814" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.459263] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-918f4ea7-500f-4b21-931f-a0af5ed8d814" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.459263] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('918f4ea7-500f-4b21-931f-a0af5ed8d814',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.963525] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 918f4ea7-500f-4b21-931f-a0af5ed8d814 [ 619.963525] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.963525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.963525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.963525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.963525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.963525] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:918f4ea7-500f-4b21-931f-a0af5ed8d814 already deleted. [ 619.963525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-918f4ea7-500f-4b21-931f-a0af5ed8d814" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.093514] env[69559]: INFO networking_nsxv3.common.synchronization [None req-16959b76-3e61-45a9-836f-9c9334af84ee None None] Enqueued Resource ID: c0bfdbe7-e0d4-4a96-8f9a-b136b45ced19 with Priority: HIGHEST for action port [ 620.093803] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0bfdbe7-e0d4-4a96-8f9a-b136b45ced19 with Priority: HIGHEST for action port [ 620.094327] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0bfdbe7-e0d4-4a96-8f9a-b136b45ced19 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.094456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0bfdbe7-e0d4-4a96-8f9a-b136b45ced19" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.094509] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0bfdbe7-e0d4-4a96-8f9a-b136b45ced19" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.094754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0bfdbe7-e0d4-4a96-8f9a-b136b45ced19" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.094831] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0bfdbe7-e0d4-4a96-8f9a-b136b45ced19',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.602487] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0bfdbe7-e0d4-4a96-8f9a-b136b45ced19 [ 620.602761] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.603486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.603486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.603486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.603486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.603486] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0bfdbe7-e0d4-4a96-8f9a-b136b45ced19 already deleted. [ 620.603706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0bfdbe7-e0d4-4a96-8f9a-b136b45ced19" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.002601] env[69559]: INFO networking_nsxv3.common.synchronization [None req-7db88f6c-0797-4ff9-aeba-ece77d6df68d None None] Enqueued Resource ID: 9478c982-9880-435b-aa08-64e4bcb11e27 with Priority: HIGHEST for action port [ 622.002601] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9478c982-9880-435b-aa08-64e4bcb11e27 with Priority: HIGHEST for action port [ 622.004405] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-9478c982-9880-435b-aa08-64e4bcb11e27 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.004405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9478c982-9880-435b-aa08-64e4bcb11e27" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.004405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9478c982-9880-435b-aa08-64e4bcb11e27" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.004405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9478c982-9880-435b-aa08-64e4bcb11e27" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.004405] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9478c982-9880-435b-aa08-64e4bcb11e27',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.105685] env[69559]: INFO networking_nsxv3.common.synchronization [None req-2db6d3ce-437c-4de0-903f-5c6c5aebb5d8 None None] Enqueued Resource ID: b11ad902-7778-4cbd-94ec-536f5fef814e with Priority: HIGHEST for action port [ 622.105685] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b11ad902-7778-4cbd-94ec-536f5fef814e with Priority: HIGHEST for action port [ 622.105685] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-b11ad902-7778-4cbd-94ec-536f5fef814e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.105685] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b11ad902-7778-4cbd-94ec-536f5fef814e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.105685] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b11ad902-7778-4cbd-94ec-536f5fef814e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.105685] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b11ad902-7778-4cbd-94ec-536f5fef814e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.105685] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b11ad902-7778-4cbd-94ec-536f5fef814e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.507276] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9478c982-9880-435b-aa08-64e4bcb11e27 [ 622.507504] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.507643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.507760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.507975] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.508072] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.508164] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9478c982-9880-435b-aa08-64e4bcb11e27 already deleted. [ 622.508242] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9478c982-9880-435b-aa08-64e4bcb11e27" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.608541] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b11ad902-7778-4cbd-94ec-536f5fef814e [ 622.609336] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.609336] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.609336] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.609336] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.609336] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.609336] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b11ad902-7778-4cbd-94ec-536f5fef814e already deleted. [ 622.609573] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b11ad902-7778-4cbd-94ec-536f5fef814e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.275023] env[69559]: INFO networking_nsxv3.common.synchronization [None req-b592da17-15f3-4267-9f94-805f961217a6 None None] Enqueued Resource ID: 67d48eb0-e78b-452d-8a04-340d8d7230f0 with Priority: HIGHEST for action port [ 623.275640] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67d48eb0-e78b-452d-8a04-340d8d7230f0 with Priority: HIGHEST for action port [ 623.275881] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-67d48eb0-e78b-452d-8a04-340d8d7230f0 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.276020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67d48eb0-e78b-452d-8a04-340d8d7230f0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.276020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67d48eb0-e78b-452d-8a04-340d8d7230f0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.276346] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67d48eb0-e78b-452d-8a04-340d8d7230f0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.276346] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67d48eb0-e78b-452d-8a04-340d8d7230f0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.778438] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67d48eb0-e78b-452d-8a04-340d8d7230f0 [ 623.778672] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.778815] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.778890] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.779101] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.779217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.779286] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67d48eb0-e78b-452d-8a04-340d8d7230f0 already deleted. [ 623.779364] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67d48eb0-e78b-452d-8a04-340d8d7230f0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.174014] env[69559]: INFO networking_nsxv3.common.synchronization [req-d16d0d2c-0979-40e1-bf5d-b65190494a2d req-0229b66c-c0f4-496b-8d66-37678f7f8310 tempest-SecurityGroupRulesNegativeTestJSON-89826865 tempest-SecurityGroupRulesNegativeTestJSON-89826865-project-member] Enqueued Resource ID: 8f8a86cb-6df9-4b6b-9f55-cd76a9f195a0 with Priority: HIGHEST for action security_group_rules [ 624.174387] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8a86cb-6df9-4b6b-9f55-cd76a9f195a0 with Priority: HIGHEST for action security_group_rules [ 624.175114] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f8a86cb-6df9-4b6b-9f55-cd76a9f195a0 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.175316] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f8a86cb-6df9-4b6b-9f55-cd76a9f195a0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.175435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f8a86cb-6df9-4b6b-9f55-cd76a9f195a0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.175727] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f8a86cb-6df9-4b6b-9f55-cd76a9f195a0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.175964] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f8a86cb-6df9-4b6b-9f55-cd76a9f195a0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.609044] env[69559]: INFO networking_nsxv3.common.synchronization [None req-c849de76-9ef6-4218-859f-2763ecb1ac96 None None] Enqueued Resource ID: ad5f7db9-e95d-4b47-950b-dfc3ce78ba57 with Priority: HIGHEST for action port [ 624.609044] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad5f7db9-e95d-4b47-950b-dfc3ce78ba57 with Priority: HIGHEST for action port [ 624.609044] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad5f7db9-e95d-4b47-950b-dfc3ce78ba57 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.609044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad5f7db9-e95d-4b47-950b-dfc3ce78ba57" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.609044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad5f7db9-e95d-4b47-950b-dfc3ce78ba57" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.609044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad5f7db9-e95d-4b47-950b-dfc3ce78ba57" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.609044] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad5f7db9-e95d-4b47-950b-dfc3ce78ba57',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.697588] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.697706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.697749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.697949] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.698048] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.698142] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f8a86cb-6df9-4b6b-9f55-cd76a9f195a0 already deleted. [ 624.698221] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f8a86cb-6df9-4b6b-9f55-cd76a9f195a0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.112334] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad5f7db9-e95d-4b47-950b-dfc3ce78ba57 [ 625.112642] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.112825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.112913] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.113168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.113272] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.113387] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad5f7db9-e95d-4b47-950b-dfc3ce78ba57 already deleted. [ 625.113492] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad5f7db9-e95d-4b47-950b-dfc3ce78ba57" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.274234] env[69559]: INFO networking_nsxv3.common.synchronization [None req-3e830522-ce05-4409-b916-42d04cefb664 None None] Enqueued Resource ID: d5e9dc3c-b0a8-4536-a222-2035eff8965b with Priority: HIGHEST for action port [ 625.275765] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5e9dc3c-b0a8-4536-a222-2035eff8965b with Priority: HIGHEST for action port [ 625.276151] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5e9dc3c-b0a8-4536-a222-2035eff8965b taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.276347] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5e9dc3c-b0a8-4536-a222-2035eff8965b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.276347] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5e9dc3c-b0a8-4536-a222-2035eff8965b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.276749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5e9dc3c-b0a8-4536-a222-2035eff8965b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.276749] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5e9dc3c-b0a8-4536-a222-2035eff8965b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.780929] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d5e9dc3c-b0a8-4536-a222-2035eff8965b [ 625.781645] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.782781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.782781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.782916] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.782987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.783119] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d5e9dc3c-b0a8-4536-a222-2035eff8965b already deleted. [ 625.783206] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5e9dc3c-b0a8-4536-a222-2035eff8965b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.202861] env[69559]: INFO networking_nsxv3.common.synchronization [None req-ba7c4ba0-650c-4b87-aaa1-90f6bccd0795 None None] Enqueued Resource ID: ff67c8ec-eaaa-4aad-a660-b92959fd5fe8 with Priority: HIGHEST for action port [ 626.203127] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff67c8ec-eaaa-4aad-a660-b92959fd5fe8 with Priority: HIGHEST for action port [ 626.203662] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff67c8ec-eaaa-4aad-a660-b92959fd5fe8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.205736] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff67c8ec-eaaa-4aad-a660-b92959fd5fe8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.205736] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff67c8ec-eaaa-4aad-a660-b92959fd5fe8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.205736] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff67c8ec-eaaa-4aad-a660-b92959fd5fe8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.205736] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff67c8ec-eaaa-4aad-a660-b92959fd5fe8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.708123] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff67c8ec-eaaa-4aad-a660-b92959fd5fe8 [ 626.710646] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.710646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.710646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.710646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.710646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.710646] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff67c8ec-eaaa-4aad-a660-b92959fd5fe8 already deleted. [ 626.710646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff67c8ec-eaaa-4aad-a660-b92959fd5fe8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.052697] env[69559]: INFO networking_nsxv3.common.synchronization [req-1c7dc069-e225-4181-8bde-8083782961b9 req-6a035fc7-eb69-4f62-8feb-1e9d7890225e tempest-SecurityGroupRulesNegativeTestJSON-89826865 tempest-SecurityGroupRulesNegativeTestJSON-89826865-project-member] Enqueued Resource ID: 8f8a86cb-6df9-4b6b-9f55-cd76a9f195a0 with Priority: HIGHEST for action security_group_rules [ 627.053785] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8a86cb-6df9-4b6b-9f55-cd76a9f195a0 with Priority: HIGHEST for action security_group_rules [ 627.053785] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f8a86cb-6df9-4b6b-9f55-cd76a9f195a0 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.053785] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f8a86cb-6df9-4b6b-9f55-cd76a9f195a0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.053944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f8a86cb-6df9-4b6b-9f55-cd76a9f195a0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.054296] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f8a86cb-6df9-4b6b-9f55-cd76a9f195a0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.054296] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f8a86cb-6df9-4b6b-9f55-cd76a9f195a0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.382439] env[69559]: INFO networking_nsxv3.common.synchronization [None req-bfb19ab0-3fb0-4637-9c16-75503182e05a None None] Enqueued Resource ID: 3cf7db09-7d3c-4bf8-9060-84c0cc05c1b3 with Priority: HIGHEST for action port [ 627.382890] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cf7db09-7d3c-4bf8-9060-84c0cc05c1b3 with Priority: HIGHEST for action port [ 627.383046] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cf7db09-7d3c-4bf8-9060-84c0cc05c1b3 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.383169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cf7db09-7d3c-4bf8-9060-84c0cc05c1b3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.383233] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cf7db09-7d3c-4bf8-9060-84c0cc05c1b3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.383480] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cf7db09-7d3c-4bf8-9060-84c0cc05c1b3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.385999] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cf7db09-7d3c-4bf8-9060-84c0cc05c1b3',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.577228] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.577380] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.577380] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.577623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.577741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.577835] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f8a86cb-6df9-4b6b-9f55-cd76a9f195a0 already deleted. [ 627.577920] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f8a86cb-6df9-4b6b-9f55-cd76a9f195a0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.889498] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cf7db09-7d3c-4bf8-9060-84c0cc05c1b3 [ 627.889769] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.889919] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.889988] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.890232] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.890332] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.890474] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cf7db09-7d3c-4bf8-9060-84c0cc05c1b3 already deleted. [ 627.890571] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cf7db09-7d3c-4bf8-9060-84c0cc05c1b3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.069759] env[69559]: INFO networking_nsxv3.common.synchronization [None req-8e99693b-6dfa-4b05-9d5a-91ef9774974e None None] Enqueued Resource ID: 42f61ea3-af06-47e3-a553-b5c31a9a59fb with Priority: HIGHEST for action port [ 628.070348] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42f61ea3-af06-47e3-a553-b5c31a9a59fb with Priority: HIGHEST for action port [ 628.070692] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-42f61ea3-af06-47e3-a553-b5c31a9a59fb taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.070818] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42f61ea3-af06-47e3-a553-b5c31a9a59fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.070911] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42f61ea3-af06-47e3-a553-b5c31a9a59fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.073265] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42f61ea3-af06-47e3-a553-b5c31a9a59fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.073413] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42f61ea3-af06-47e3-a553-b5c31a9a59fb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.579736] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42f61ea3-af06-47e3-a553-b5c31a9a59fb [ 628.581811] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.581811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.581811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.581811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.581811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.581811] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42f61ea3-af06-47e3-a553-b5c31a9a59fb already deleted. [ 628.581811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42f61ea3-af06-47e3-a553-b5c31a9a59fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.661110] env[69559]: INFO networking_nsxv3.common.synchronization [None req-72fe8b6f-8d30-4ab7-8482-4f1ea099a842 None None] Enqueued Resource ID: 816b8335-ece2-4895-bce3-297821a1a5ce with Priority: HIGHEST for action port [ 628.661110] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 816b8335-ece2-4895-bce3-297821a1a5ce with Priority: HIGHEST for action port [ 628.662799] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-816b8335-ece2-4895-bce3-297821a1a5ce taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.662799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-816b8335-ece2-4895-bce3-297821a1a5ce" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.662799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-816b8335-ece2-4895-bce3-297821a1a5ce" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.662799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-816b8335-ece2-4895-bce3-297821a1a5ce" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.662799] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('816b8335-ece2-4895-bce3-297821a1a5ce',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.954849] env[69559]: INFO networking_nsxv3.common.synchronization [None req-7bd0b548-07cd-4c85-89ba-4c1a91062ce9 tempest-VolumesAssistedSnapshotsTest-466925179 tempest-VolumesAssistedSnapshotsTest-466925179-project-member] Enqueued Resource ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe with Priority: HIGHEST for action security_group_rules [ 628.955588] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe with Priority: HIGHEST for action security_group_rules [ 628.955897] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39b15e36-c638-4ca0-a065-67c76e8f79fe taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.958165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.958329] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.958700] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.958784] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39b15e36-c638-4ca0-a065-67c76e8f79fe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.138026] env[69559]: INFO networking_nsxv3.common.synchronization [req-4c511a60-c15d-420f-b5fe-8d771ad62684 req-4fd3dfb7-e16e-424e-bb9e-54cb06658225 tempest-ServersAdminTestJSON-1923717545 tempest-ServersAdminTestJSON-1923717545-project-member] Enqueued Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 629.138026] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 629.138680] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.140616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.140616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.140616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.140616] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.140616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.140616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.140616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.140616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.140616] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.166450] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 816b8335-ece2-4895-bce3-297821a1a5ce [ 629.166610] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.166755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.166821] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.166976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.167081] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.168255] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:816b8335-ece2-4895-bce3-297821a1a5ce already deleted. [ 629.168374] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-816b8335-ece2-4895-bce3-297821a1a5ce" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.175976] env[69559]: INFO networking_nsxv3.common.synchronization [None req-f7650d13-1916-42c5-92b9-c2aecba49f7a tempest-VolumesAssistedSnapshotsTest-466925179 tempest-VolumesAssistedSnapshotsTest-466925179-project-member] Enqueued Resource ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe with Priority: HIGHEST for action security_group_rules [ 629.175976] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe with Priority: HIGHEST for action security_group_rules [ 629.178872] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39b15e36-c638-4ca0-a065-67c76e8f79fe taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.178872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.482610] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.482798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.482901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.483109] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.483308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.483308] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe already deleted. [ 629.483411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.483897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.484150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.484245] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39b15e36-c638-4ca0-a065-67c76e8f79fe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.645247] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.645247] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.645247] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.649022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.649022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.649022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.649022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.649022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.649022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.649022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.649022] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fab5e96-3f01-4c71-994f-69059ca62986 already deleted. [ 629.649022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.005088] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.005293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.005356] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.005511] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.005600] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.005696] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe already deleted. [ 630.005779] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.218727] env[69559]: INFO networking_nsxv3.common.synchronization [None req-d2c3506b-c4f2-4ef2-a3f9-0f7f95651686 None None] Enqueued Resource ID: 797231fe-027d-4828-a1d6-cdaea79af90c with Priority: HIGHEST for action port [ 630.223933] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 797231fe-027d-4828-a1d6-cdaea79af90c with Priority: HIGHEST for action port [ 630.223933] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-797231fe-027d-4828-a1d6-cdaea79af90c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.223933] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-797231fe-027d-4828-a1d6-cdaea79af90c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.223933] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-797231fe-027d-4828-a1d6-cdaea79af90c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.223933] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-797231fe-027d-4828-a1d6-cdaea79af90c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.223933] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('797231fe-027d-4828-a1d6-cdaea79af90c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.380160] env[69559]: INFO networking_nsxv3.common.synchronization [req-0a4fb058-69a1-4ec4-830f-e10ea5754cc3 req-bb81450c-06a5-4ba1-a08c-5377bc6dd043 tempest-SecurityGroupRulesTestJSON-1047272370 tempest-SecurityGroupRulesTestJSON-1047272370-project-member] Enqueued Resource ID: 091ab61e-1980-486e-8d11-f2620c382ba7 with Priority: HIGHEST for action security_group_rules [ 630.380160] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 091ab61e-1980-486e-8d11-f2620c382ba7 with Priority: HIGHEST for action security_group_rules [ 630.380160] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-091ab61e-1980-486e-8d11-f2620c382ba7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.380160] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-091ab61e-1980-486e-8d11-f2620c382ba7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.380160] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-091ab61e-1980-486e-8d11-f2620c382ba7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.380814] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-091ab61e-1980-486e-8d11-f2620c382ba7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.380998] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('091ab61e-1980-486e-8d11-f2620c382ba7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.727500] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 797231fe-027d-4828-a1d6-cdaea79af90c [ 630.729739] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.729739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.729739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.729739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.729739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.729739] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:797231fe-027d-4828-a1d6-cdaea79af90c already deleted. [ 630.729739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-797231fe-027d-4828-a1d6-cdaea79af90c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.805620] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.805819] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-517" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.805975] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-517" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.806293] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-517" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.807019] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.807330] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.807663] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.807960] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.808335] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.808430] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 630.808580] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 630.808815] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 630.809047] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 630.809140] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 630.809532] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 630.809532] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 630.830296] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 630.830458] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 630.830737] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 630.830791] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-517" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.831185] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-b66f1dad-d297-43f9-86ef-66719ca4b27c taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.832376] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-b66f1dad-d297-43f9-86ef-66719ca4b27c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.832376] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-b66f1dad-d297-43f9-86ef-66719ca4b27c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.832376] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-b66f1dad-d297-43f9-86ef-66719ca4b27c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.832376] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b66f1dad-d297-43f9-86ef-66719ca4b27c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.901895] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.902217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.902733] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.902733] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.902733] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.902733] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 091ab61e-1980-486e-8d11-f2620c382ba7 already deleted. [ 630.902881] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-091ab61e-1980-486e-8d11-f2620c382ba7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.336682] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.336988] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.338019] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.338019] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.338019] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.338019] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port b66f1dad-d297-43f9-86ef-66719ca4b27c not found, creating... [ 631.338361] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.338361] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.338450] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.338652] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.338789] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.339194] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.339352] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.339470] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.339677] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.339808] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.339948] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: b66f1dad-d297-43f9-86ef-66719ca4b27c is going to be created. [ 631.362083] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.362369] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.362498] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.363530] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.363530] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.363530] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-b66f1dad-d297-43f9-86ef-66719ca4b27c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.492673] env[69559]: INFO networking_nsxv3.common.synchronization [req-ae20e3fc-5a6d-4483-807c-9cbeb51f9a75 req-7ccfc3f8-0ff8-4326-a586-0617c99d7ba9 tempest-DeleteServersAdminTestJSON-301366711 tempest-DeleteServersAdminTestJSON-301366711-project-member] Enqueued Resource ID: b5e555cc-4bc4-4e59-b77f-deda078818fb with Priority: HIGHEST for action security_group_members [ 631.498290] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5e555cc-4bc4-4e59-b77f-deda078818fb with Priority: HIGHEST for action security_group_members [ 631.498290] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5e555cc-4bc4-4e59-b77f-deda078818fb taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.498290] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.498290] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.498290] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.498290] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.498290] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.498290] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.498290] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.498290] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.498290] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5e555cc-4bc4-4e59-b77f-deda078818fb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.504412] env[69559]: INFO networking_nsxv3.common.synchronization [None req-76c7ac85-07f5-4600-a1d7-432bda92eb9a None None] Enqueued Resource ID: 0f754788-c477-42f5-a138-eadaed1755f8 with Priority: HIGHEST for action port [ 631.505315] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f754788-c477-42f5-a138-eadaed1755f8 with Priority: HIGHEST for action port [ 631.505315] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f754788-c477-42f5-a138-eadaed1755f8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.505466] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f754788-c477-42f5-a138-eadaed1755f8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.505466] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f754788-c477-42f5-a138-eadaed1755f8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.505644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f754788-c477-42f5-a138-eadaed1755f8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.505733] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f754788-c477-42f5-a138-eadaed1755f8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.575420] env[69559]: INFO networking_nsxv3.common.synchronization [None req-e5ca6676-35a7-42db-91c6-125017db8daf None None] Enqueued Resource ID: 4cf6b7e0-fceb-40b1-ac8b-d5174df26fd1 with Priority: HIGHEST for action port [ 631.576651] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cf6b7e0-fceb-40b1-ac8b-d5174df26fd1 with Priority: HIGHEST for action port [ 631.577790] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cf6b7e0-fceb-40b1-ac8b-d5174df26fd1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.578136] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cf6b7e0-fceb-40b1-ac8b-d5174df26fd1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.578299] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cf6b7e0-fceb-40b1-ac8b-d5174df26fd1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.578730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cf6b7e0-fceb-40b1-ac8b-d5174df26fd1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.578903] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cf6b7e0-fceb-40b1-ac8b-d5174df26fd1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.999333] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.999500] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.999573] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.999794] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.999887] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.000097] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.000196] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.000259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.000408] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.000486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.000575] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5e555cc-4bc4-4e59-b77f-deda078818fb already deleted. [ 632.000676] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.008185] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f754788-c477-42f5-a138-eadaed1755f8 [ 632.008416] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.008568] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.008636] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.008843] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.008942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.009033] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f754788-c477-42f5-a138-eadaed1755f8 already deleted. [ 632.009134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f754788-c477-42f5-a138-eadaed1755f8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.081968] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4cf6b7e0-fceb-40b1-ac8b-d5174df26fd1 [ 632.081968] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.081968] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.082726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.083051] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.083179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.083289] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4cf6b7e0-fceb-40b1-ac8b-d5174df26fd1 already deleted. [ 632.083374] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cf6b7e0-fceb-40b1-ac8b-d5174df26fd1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.370396] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.370396] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.370396] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.370396] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.370864] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.370864] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.370957] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.373752] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.373752] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.373752] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 632.373752] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 632.373752] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 632.373752] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 632.373752] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 632.373752] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 632.373752] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 632.391188] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 632.391515] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 632.391660] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 632.391996] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.392064] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-83bf58e9-9ab4-4cb8-ade5-3547224b9083 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.392373] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-83bf58e9-9ab4-4cb8-ade5-3547224b9083" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.392467] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-83bf58e9-9ab4-4cb8-ade5-3547224b9083" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.392783] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-83bf58e9-9ab4-4cb8-ade5-3547224b9083" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.392916] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83bf58e9-9ab4-4cb8-ade5-3547224b9083',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.396918] env[69559]: INFO networking_nsxv3.common.synchronization [req-4c511a60-c15d-420f-b5fe-8d771ad62684 req-bb47db3f-9e27-4dc3-8903-7590ae530590 service nova] Enqueued Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_rules [ 632.397018] env[69559]: INFO networking_nsxv3.common.synchronization [req-4c511a60-c15d-420f-b5fe-8d771ad62684 req-bb47db3f-9e27-4dc3-8903-7590ae530590 service nova] Enqueued Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 632.399107] env[69559]: INFO networking_nsxv3.common.synchronization [req-4c511a60-c15d-420f-b5fe-8d771ad62684 req-bb47db3f-9e27-4dc3-8903-7590ae530590 service nova] Enqueued Resource ID: b66f1dad-d297-43f9-86ef-66719ca4b27c with Priority: HIGHEST for action port [ 632.399107] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_rules [ 632.399107] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 632.399107] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b66f1dad-d297-43f9-86ef-66719ca4b27c with Priority: HIGHEST for action port [ 632.399107] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.399107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.399107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.399107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.399107] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.401072] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.401192] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.401259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.401468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.401624] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.401722] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.401782] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.401924] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.402013] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.402119] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.403180] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-b66f1dad-d297-43f9-86ef-66719ca4b27c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.404044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b66f1dad-d297-43f9-86ef-66719ca4b27c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.404044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b66f1dad-d297-43f9-86ef-66719ca4b27c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.404044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b66f1dad-d297-43f9-86ef-66719ca4b27c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.404044] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b66f1dad-d297-43f9-86ef-66719ca4b27c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.808577] env[69559]: INFO networking_nsxv3.common.synchronization [None req-b0b12966-eb48-416f-a8f2-79f1234da254 None None] Enqueued Resource ID: 19cb69ba-9b3a-4ba8-a8cb-d5e243b3f3dd with Priority: HIGHEST for action port [ 632.809849] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19cb69ba-9b3a-4ba8-a8cb-d5e243b3f3dd with Priority: HIGHEST for action port [ 632.809849] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-19cb69ba-9b3a-4ba8-a8cb-d5e243b3f3dd taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.809849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19cb69ba-9b3a-4ba8-a8cb-d5e243b3f3dd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.809849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19cb69ba-9b3a-4ba8-a8cb-d5e243b3f3dd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.810497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19cb69ba-9b3a-4ba8-a8cb-d5e243b3f3dd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.810711] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19cb69ba-9b3a-4ba8-a8cb-d5e243b3f3dd',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.897574] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.897574] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.897574] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.897806] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.897806] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.898163] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 83bf58e9-9ab4-4cb8-ade5-3547224b9083 not found, creating... [ 632.898242] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.898378] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.898493] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.898710] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.898844] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.899151] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.900169] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.900169] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.900169] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.900169] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.900169] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 83bf58e9-9ab4-4cb8-ade5-3547224b9083 is going to be created. [ 632.908217] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.908654] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.920798] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b66f1dad-d297-43f9-86ef-66719ca4b27c with status ACTIVE [ 632.920798] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.920798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.920798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.920798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.920798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.920798] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.920798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.920798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.920798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.920798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.920798] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.920798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.920798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.920798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.920798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.920798] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b66f1dad-d297-43f9-86ef-66719ca4b27c is going to be updated. [ 632.924502] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.925193] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.925477] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.925796] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.926116] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.929511] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-83bf58e9-9ab4-4cb8-ade5-3547224b9083" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.929511] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.972620] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.972620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.972620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.972620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.972620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.972620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b66f1dad-d297-43f9-86ef-66719ca4b27c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.317213] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 19cb69ba-9b3a-4ba8-a8cb-d5e243b3f3dd [ 633.317213] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.317213] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.317213] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.317213] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.317714] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.318244] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:19cb69ba-9b3a-4ba8-a8cb-d5e243b3f3dd already deleted. [ 633.318244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19cb69ba-9b3a-4ba8-a8cb-d5e243b3f3dd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.331470] env[69559]: INFO networking_nsxv3.common.synchronization [req-60593ad5-7735-49b1-8d86-b86546e220f8 req-3fd7ab2e-0a3b-485f-9f37-b94770a361ec tempest-ServerExternalEventsTest-1068033534 tempest-ServerExternalEventsTest-1068033534-project-member] Enqueued Resource ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 with Priority: HIGHEST for action security_group_members [ 633.331566] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 with Priority: HIGHEST for action security_group_members [ 633.331832] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.331959] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.334150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.334309] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.334343] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.334661] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.334661] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.334765] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.334936] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.334936] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb31ec23-00b3-411e-81c7-83cd3eaa45d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.432150] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.837081] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.837256] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.837475] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.837529] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.837604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.837817] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.837916] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.837988] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.838142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.838214] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.838297] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 already deleted. [ 633.838372] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.868054] env[69559]: INFO networking_nsxv3.common.synchronization [None req-21d0137e-9e4a-4446-8873-8b1f5de7d322 None None] Enqueued Resource ID: 6b0a5d02-490c-4fef-aa2d-bf6f85c7ff54 with Priority: HIGHEST for action port [ 633.868392] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b0a5d02-490c-4fef-aa2d-bf6f85c7ff54 with Priority: HIGHEST for action port [ 633.869289] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b0a5d02-490c-4fef-aa2d-bf6f85c7ff54 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.869940] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b0a5d02-490c-4fef-aa2d-bf6f85c7ff54" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.869940] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b0a5d02-490c-4fef-aa2d-bf6f85c7ff54" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.869940] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b0a5d02-490c-4fef-aa2d-bf6f85c7ff54" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.869940] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b0a5d02-490c-4fef-aa2d-bf6f85c7ff54',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.882623] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.882739] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.882786] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.883051] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.883793] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.883793] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.883793] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.884017] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.884135] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.884422] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 633.884625] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 633.884625] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 633.884735] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 633.884879] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 633.884987] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 633.885122] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 633.903889] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 633.903889] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 633.903889] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 633.903889] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.903889] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-48a65d59-11b7-4b13-96ab-bf61e0a428fc taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.904427] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-48a65d59-11b7-4b13-96ab-bf61e0a428fc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.904692] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-48a65d59-11b7-4b13-96ab-bf61e0a428fc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.905418] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-48a65d59-11b7-4b13-96ab-bf61e0a428fc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.905667] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48a65d59-11b7-4b13-96ab-bf61e0a428fc',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.937419] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.937419] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.937419] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.937419] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.937419] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.937419] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fab5e96-3f01-4c71-994f-69059ca62986 is going to be created. [ 633.964029] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.964029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.964029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.964029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.964029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.973084] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: UNINITIALIZED for 2s [ 634.088322] env[69559]: INFO networking_nsxv3.common.synchronization [req-dbbd55f7-eb4e-4a74-8c8e-12c5ab1973ca req-2b03c5c6-bfeb-46e9-8ed7-67670b44265c tempest-SecurityGroupRulesTestJSON-1047272370 tempest-SecurityGroupRulesTestJSON-1047272370-project-member] Enqueued Resource ID: f227c57b-6a90-4fcb-b587-72012c6692e6 with Priority: HIGHEST for action security_group_rules [ 634.088764] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f227c57b-6a90-4fcb-b587-72012c6692e6 with Priority: HIGHEST for action security_group_rules [ 634.089093] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f227c57b-6a90-4fcb-b587-72012c6692e6 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.089215] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f227c57b-6a90-4fcb-b587-72012c6692e6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.089287] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f227c57b-6a90-4fcb-b587-72012c6692e6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.089525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f227c57b-6a90-4fcb-b587-72012c6692e6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.089604] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f227c57b-6a90-4fcb-b587-72012c6692e6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.130245] env[69559]: INFO networking_nsxv3.common.synchronization [req-ae20e3fc-5a6d-4483-807c-9cbeb51f9a75 req-449eee30-8aeb-454b-9cab-a8907237bc89 service nova] Enqueued Resource ID: b5e555cc-4bc4-4e59-b77f-deda078818fb with Priority: HIGHEST for action security_group_rules [ 634.130408] env[69559]: INFO networking_nsxv3.common.synchronization [req-ae20e3fc-5a6d-4483-807c-9cbeb51f9a75 req-449eee30-8aeb-454b-9cab-a8907237bc89 service nova] Enqueued Resource ID: b5e555cc-4bc4-4e59-b77f-deda078818fb with Priority: HIGHEST for action security_group_members [ 634.130548] env[69559]: INFO networking_nsxv3.common.synchronization [req-ae20e3fc-5a6d-4483-807c-9cbeb51f9a75 req-449eee30-8aeb-454b-9cab-a8907237bc89 service nova] Enqueued Resource ID: 83bf58e9-9ab4-4cb8-ade5-3547224b9083 with Priority: HIGHEST for action port [ 634.131314] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5e555cc-4bc4-4e59-b77f-deda078818fb with Priority: HIGHEST for action security_group_rules [ 634.131314] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5e555cc-4bc4-4e59-b77f-deda078818fb with Priority: HIGHEST for action security_group_members [ 634.131512] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83bf58e9-9ab4-4cb8-ade5-3547224b9083 with Priority: HIGHEST for action port [ 634.132679] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5e555cc-4bc4-4e59-b77f-deda078818fb taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.132679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.132679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.132679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.132679] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5e555cc-4bc4-4e59-b77f-deda078818fb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.137068] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5e555cc-4bc4-4e59-b77f-deda078818fb taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.137068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.137068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.137068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.137068] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.137068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.137068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.137627] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.137627] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.137627] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5e555cc-4bc4-4e59-b77f-deda078818fb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.138470] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-83bf58e9-9ab4-4cb8-ade5-3547224b9083 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.138584] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83bf58e9-9ab4-4cb8-ade5-3547224b9083" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.138636] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83bf58e9-9ab4-4cb8-ade5-3547224b9083" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.143017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83bf58e9-9ab4-4cb8-ade5-3547224b9083" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.143017] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83bf58e9-9ab4-4cb8-ade5-3547224b9083',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.374671] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b0a5d02-490c-4fef-aa2d-bf6f85c7ff54 [ 634.374671] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.374671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.374671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.374671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.374671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.374671] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b0a5d02-490c-4fef-aa2d-bf6f85c7ff54 already deleted. [ 634.374671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b0a5d02-490c-4fef-aa2d-bf6f85c7ff54" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.412217] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.412217] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.412217] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.412217] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.412217] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.412217] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 48a65d59-11b7-4b13-96ab-bf61e0a428fc not found, creating... [ 634.412217] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.412217] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.412217] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.412217] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.412217] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.412687] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.412687] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.412687] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.414345] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.414345] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.414479] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 48a65d59-11b7-4b13-96ab-bf61e0a428fc is going to be created. [ 634.442590] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.443120] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.443120] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.443349] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.443607] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.443853] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-48a65d59-11b7-4b13-96ab-bf61e0a428fc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.620230] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.620410] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.620493] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.620732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.620828] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.620933] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f227c57b-6a90-4fcb-b587-72012c6692e6 already deleted. [ 634.621036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f227c57b-6a90-4fcb-b587-72012c6692e6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.644680] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5e555cc-4bc4-4e59-b77f-deda078818fb taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.644855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.645061] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5e555cc-4bc4-4e59-b77f-deda078818fb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.647123] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83bf58e9-9ab4-4cb8-ade5-3547224b9083 with status ACTIVE [ 634.647243] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.647368] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.647436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.647641] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.647749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.647951] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.648104] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.648209] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.648386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.648473] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.648735] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.648918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.648918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.649075] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.649177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.649491] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83bf58e9-9ab4-4cb8-ade5-3547224b9083 is going to be updated. [ 634.669419] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.669694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.669980] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.669980] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.670133] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.670329] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83bf58e9-9ab4-4cb8-ade5-3547224b9083" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.151674] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5e555cc-4bc4-4e59-b77f-deda078818fb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.633082] env[69559]: INFO networking_nsxv3.common.synchronization [req-60593ad5-7735-49b1-8d86-b86546e220f8 req-340e30e4-e300-46a5-9805-ead0d1c1f6d6 service nova] Enqueued Resource ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 with Priority: HIGHEST for action security_group_rules [ 635.633318] env[69559]: INFO networking_nsxv3.common.synchronization [req-60593ad5-7735-49b1-8d86-b86546e220f8 req-340e30e4-e300-46a5-9805-ead0d1c1f6d6 service nova] Enqueued Resource ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 with Priority: HIGHEST for action security_group_members [ 635.633406] env[69559]: INFO networking_nsxv3.common.synchronization [req-60593ad5-7735-49b1-8d86-b86546e220f8 req-340e30e4-e300-46a5-9805-ead0d1c1f6d6 service nova] Enqueued Resource ID: 48a65d59-11b7-4b13-96ab-bf61e0a428fc with Priority: HIGHEST for action port [ 635.633896] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 with Priority: HIGHEST for action security_group_rules [ 635.634590] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 with Priority: HIGHEST for action security_group_members [ 635.634590] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48a65d59-11b7-4b13-96ab-bf61e0a428fc with Priority: HIGHEST for action port [ 635.634590] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb31ec23-00b3-411e-81c7-83cd3eaa45d8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.634590] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.634590] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.634881] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.634881] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb31ec23-00b3-411e-81c7-83cd3eaa45d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.636379] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.636379] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.636379] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.636684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.637027] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.637027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.637102] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.637267] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.637739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.637739] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb31ec23-00b3-411e-81c7-83cd3eaa45d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.638444] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-48a65d59-11b7-4b13-96ab-bf61e0a428fc taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.638444] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48a65d59-11b7-4b13-96ab-bf61e0a428fc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.638444] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48a65d59-11b7-4b13-96ab-bf61e0a428fc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.638773] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48a65d59-11b7-4b13-96ab-bf61e0a428fc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.638773] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48a65d59-11b7-4b13-96ab-bf61e0a428fc',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.656024] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.656024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.656024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.656024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.656024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.657101] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5e555cc-4bc4-4e59-b77f-deda078818fb is going to be created. [ 635.683772] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.683772] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.683772] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.683772] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.683772] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.692400] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5e555cc-4bc4-4e59-b77f-deda078818fb in Status: UNINITIALIZED for 2s [ 635.985656] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: SUCCESS [ 635.985656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.985656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.985656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.985656] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.985656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.985656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.985656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.985656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.985656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.985656] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.113313] env[69559]: INFO networking_nsxv3.common.synchronization [req-51db8dbd-1cc1-4466-9bae-e1da3e53fc03 req-87975552-2412-4f86-aae2-48d6f89c7a2f tempest-ServersAdminTestJSON-1923717545 tempest-ServersAdminTestJSON-1923717545-project-member] Enqueued Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 636.113313] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 636.120077] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.120077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.120077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.120077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.120077] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.120077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.120077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.120077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.120077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.120077] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.150020] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb31ec23-00b3-411e-81c7-83cd3eaa45d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.150020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.150020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.150020] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48a65d59-11b7-4b13-96ab-bf61e0a428fc with status ACTIVE [ 636.150020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.150020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.150020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.150020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.150020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.150020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.150020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.150020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.150803] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.151536] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.151845] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.152072] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.152215] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.152807] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.153033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.153231] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48a65d59-11b7-4b13-96ab-bf61e0a428fc is going to be updated. [ 636.177155] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.177155] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.177155] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.177155] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.177155] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.177155] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48a65d59-11b7-4b13-96ab-bf61e0a428fc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.488349] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.489158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.624451] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.656252] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb31ec23-00b3-411e-81c7-83cd3eaa45d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.677103] env[69559]: INFO networking_nsxv3.common.synchronization [None req-ae0f5e78-c613-4cdd-938b-aa3804491f3c None None] Enqueued Resource ID: ce3df89a-f85b-4f1f-8dca-548b32687617 with Priority: HIGHEST for action port [ 636.677103] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce3df89a-f85b-4f1f-8dca-548b32687617 with Priority: HIGHEST for action port [ 636.677103] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce3df89a-f85b-4f1f-8dca-548b32687617 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.677103] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce3df89a-f85b-4f1f-8dca-548b32687617" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.677103] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce3df89a-f85b-4f1f-8dca-548b32687617" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.677103] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce3df89a-f85b-4f1f-8dca-548b32687617" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.678226] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce3df89a-f85b-4f1f-8dca-548b32687617',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.923470] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.924710] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-517" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.925041] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-517" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.925395] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-517" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.929177] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.929177] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.929177] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.929177] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.929177] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.929177] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 636.929177] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 636.929177] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 636.929177] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 636.929177] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 636.929177] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 636.929177] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 636.944977] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 636.945452] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 636.945705] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 636.945983] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-517" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.948017] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-32337ac0-677d-4885-9a02-ba5111d9db7f taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.948017] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-32337ac0-677d-4885-9a02-ba5111d9db7f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.948017] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-32337ac0-677d-4885-9a02-ba5111d9db7f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.948017] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-32337ac0-677d-4885-9a02-ba5111d9db7f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.948017] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32337ac0-677d-4885-9a02-ba5111d9db7f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.126755] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.161063] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.161063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.161063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.161063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.161063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.161063] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 is going to be created. [ 637.183022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.183022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.183022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.183022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.183022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.183022] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ce3df89a-f85b-4f1f-8dca-548b32687617 [ 637.183022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.183022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.183022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.183022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.183635] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.183839] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ce3df89a-f85b-4f1f-8dca-548b32687617 already deleted. [ 637.184034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce3df89a-f85b-4f1f-8dca-548b32687617" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.199033] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 in Status: UNINITIALIZED for 2s [ 637.450331] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.450563] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.450687] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.451030] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.451205] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.451367] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 32337ac0-677d-4885-9a02-ba5111d9db7f not found, creating... [ 637.451632] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.451822] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.451951] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.452199] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.452620] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.452707] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.455148] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.455292] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.455585] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.456466] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.456738] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 32337ac0-677d-4885-9a02-ba5111d9db7f is going to be created. [ 637.481809] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.482903] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.482903] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.482903] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.483168] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.484091] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-32337ac0-677d-4885-9a02-ba5111d9db7f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.629795] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.629962] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.630050] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.630466] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.630565] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.630675] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fab5e96-3f01-4c71-994f-69059ca62986 is going to be updated. [ 637.658502] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.658915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.658915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.658915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.659130] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.668173] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: IN_PROGRESS for 2s [ 637.701969] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5e555cc-4bc4-4e59-b77f-deda078818fb in Status: SUCCESS [ 637.702172] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.702621] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.702665] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.702867] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.703014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.703074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.703215] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.703340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.703394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.703483] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5e555cc-4bc4-4e59-b77f-deda078818fb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.213784] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5e555cc-4bc4-4e59-b77f-deda078818fb taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.213784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.213784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.213784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.213784] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.213784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.213784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.213784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.213784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.213784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.213784] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5e555cc-4bc4-4e59-b77f-deda078818fb taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.215655] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.215655] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.215655] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.215753] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.215836] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.216621] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.216621] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.216621] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.216621] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.216621] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5e555cc-4bc4-4e59-b77f-deda078818fb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.337051] env[69559]: INFO networking_nsxv3.common.synchronization [None req-6f79a76f-6b98-4937-af7e-f2436cc6c221 None None] Enqueued Resource ID: 7f083164-a56b-46ba-a57a-c25feb70e197 with Priority: HIGHEST for action port [ 638.337051] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f083164-a56b-46ba-a57a-c25feb70e197 with Priority: HIGHEST for action port [ 638.337051] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f083164-a56b-46ba-a57a-c25feb70e197 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.337510] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f083164-a56b-46ba-a57a-c25feb70e197" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.337691] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f083164-a56b-46ba-a57a-c25feb70e197" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.338062] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f083164-a56b-46ba-a57a-c25feb70e197" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.338351] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f083164-a56b-46ba-a57a-c25feb70e197',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.596469] env[69559]: INFO networking_nsxv3.common.synchronization [None req-127ffae1-2cb0-44b7-a050-98be42953e41 None None] Enqueued Resource ID: 3791db46-2695-4a80-9817-c57bdcd0f1b6 with Priority: HIGHEST for action port [ 638.596469] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3791db46-2695-4a80-9817-c57bdcd0f1b6 with Priority: HIGHEST for action port [ 638.596469] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-3791db46-2695-4a80-9817-c57bdcd0f1b6 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.596469] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3791db46-2695-4a80-9817-c57bdcd0f1b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.596469] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3791db46-2695-4a80-9817-c57bdcd0f1b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.596718] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3791db46-2695-4a80-9817-c57bdcd0f1b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.596757] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3791db46-2695-4a80-9817-c57bdcd0f1b6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.719137] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5e555cc-4bc4-4e59-b77f-deda078818fb: rpc.has_security_group_logging(os_id): False [ 638.738591] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.738591] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.738591] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.738591] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.738591] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.738993] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.739439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.739439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.739757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.739899] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.740452] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.740452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.740605] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.741735] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.741735] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.741735] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.741735] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.741735] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.741919] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.741947] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.742523] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5e555cc-4bc4-4e59-b77f-deda078818fb is going to be created. [ 638.747037] env[69559]: INFO networking_nsxv3.common.synchronization [req-51db8dbd-1cc1-4466-9bae-e1da3e53fc03 req-b897ab0f-a7a2-4e68-9829-fef8aa446b4f service nova] Enqueued Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_rules [ 638.747143] env[69559]: INFO networking_nsxv3.common.synchronization [req-51db8dbd-1cc1-4466-9bae-e1da3e53fc03 req-b897ab0f-a7a2-4e68-9829-fef8aa446b4f service nova] Enqueued Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 638.747737] env[69559]: INFO networking_nsxv3.common.synchronization [req-51db8dbd-1cc1-4466-9bae-e1da3e53fc03 req-b897ab0f-a7a2-4e68-9829-fef8aa446b4f service nova] Enqueued Resource ID: 32337ac0-677d-4885-9a02-ba5111d9db7f with Priority: HIGHEST for action port [ 638.747737] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_rules [ 638.747737] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 638.751156] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32337ac0-677d-4885-9a02-ba5111d9db7f with Priority: HIGHEST for action port [ 638.751156] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.751156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.751156] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.751156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.751156] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-32337ac0-677d-4885-9a02-ba5111d9db7f taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.751156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32337ac0-677d-4885-9a02-ba5111d9db7f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.751156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32337ac0-677d-4885-9a02-ba5111d9db7f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.751156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32337ac0-677d-4885-9a02-ba5111d9db7f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.751156] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32337ac0-677d-4885-9a02-ba5111d9db7f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.798174] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.798334] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.798374] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.798723] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.798839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.810925] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5e555cc-4bc4-4e59-b77f-deda078818fb in Status: IN_PROGRESS for 2s [ 638.841050] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f083164-a56b-46ba-a57a-c25feb70e197 [ 638.841283] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.841420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.841489] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.841696] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.841787] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.841879] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f083164-a56b-46ba-a57a-c25feb70e197 already deleted. [ 638.841963] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f083164-a56b-46ba-a57a-c25feb70e197" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.100250] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3791db46-2695-4a80-9817-c57bdcd0f1b6 [ 639.100250] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.100382] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.100415] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.100635] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.100752] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.100860] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3791db46-2695-4a80-9817-c57bdcd0f1b6 already deleted. [ 639.100949] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3791db46-2695-4a80-9817-c57bdcd0f1b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.205574] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 in Status: SUCCESS [ 639.205787] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.205946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.206190] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.206377] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.206489] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.206551] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.206715] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.207197] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.207197] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.207197] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb31ec23-00b3-411e-81c7-83cd3eaa45d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.256221] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32337ac0-677d-4885-9a02-ba5111d9db7f with status ACTIVE [ 639.257162] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.257162] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.257162] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.257162] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.257162] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.257417] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.257417] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.257417] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.257560] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.257601] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.259204] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.259204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.259204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.259204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.259204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.259204] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32337ac0-677d-4885-9a02-ba5111d9db7f is going to be updated. [ 639.267658] env[69559]: INFO networking_nsxv3.common.synchronization [None req-50cad3fb-3109-4721-b88e-3ce825f70fe5 None None] Enqueued Resource ID: b23e03c2-bc6f-403b-9871-b9520fe595a1 with Priority: HIGHEST for action port [ 639.267910] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b23e03c2-bc6f-403b-9871-b9520fe595a1 with Priority: HIGHEST for action port [ 639.268477] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-b23e03c2-bc6f-403b-9871-b9520fe595a1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.268589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b23e03c2-bc6f-403b-9871-b9520fe595a1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.268673] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b23e03c2-bc6f-403b-9871-b9520fe595a1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.268911] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b23e03c2-bc6f-403b-9871-b9520fe595a1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.268996] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b23e03c2-bc6f-403b-9871-b9520fe595a1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.280905] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.280905] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.281074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.281326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.281326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.281541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32337ac0-677d-4885-9a02-ba5111d9db7f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.584039] env[69559]: INFO networking_nsxv3.common.synchronization [req-c3f39690-7870-4116-ba6d-6f71dd9ed93a req-466a1fdc-8f67-42b4-ab9a-4d98ef10992c tempest-SecurityGroupRulesTestJSON-1047272370 tempest-SecurityGroupRulesTestJSON-1047272370-project-member] Enqueued Resource ID: 26cd69ad-0c37-47b1-afbe-fbfb0fe7af7b with Priority: HIGHEST for action security_group_rules [ 639.584237] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26cd69ad-0c37-47b1-afbe-fbfb0fe7af7b with Priority: HIGHEST for action security_group_rules [ 639.584564] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26cd69ad-0c37-47b1-afbe-fbfb0fe7af7b taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.584679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26cd69ad-0c37-47b1-afbe-fbfb0fe7af7b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.584744] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26cd69ad-0c37-47b1-afbe-fbfb0fe7af7b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.584987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26cd69ad-0c37-47b1-afbe-fbfb0fe7af7b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.585094] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26cd69ad-0c37-47b1-afbe-fbfb0fe7af7b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.681247] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: SUCCESS [ 639.681462] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.681627] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.681869] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.682103] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.684200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.684200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.684200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.684200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.684200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.684200] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.684200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.684200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.684818] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.684818] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.684818] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.684818] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.684959] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.685026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.685111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.685198] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.686034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.686189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.686334] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.686644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.686780] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.686974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.687103] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.687203] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.713025] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.713025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.713025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.713025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.713025] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.713025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.713025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.713025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.713025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.713025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.713025] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.713025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.713025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.713025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.713025] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.713025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.713888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.713888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.713888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.713888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.713888] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb31ec23-00b3-411e-81c7-83cd3eaa45d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.776106] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b23e03c2-bc6f-403b-9871-b9520fe595a1 [ 639.776106] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.776106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.776106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.776106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.776106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.776106] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b23e03c2-bc6f-403b-9871-b9520fe595a1 already deleted. [ 639.776106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b23e03c2-bc6f-403b-9871-b9520fe595a1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.104260] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.104260] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.104260] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.104260] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.104260] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.104553] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26cd69ad-0c37-47b1-afbe-fbfb0fe7af7b already deleted. [ 640.104553] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26cd69ad-0c37-47b1-afbe-fbfb0fe7af7b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.189559] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fab5e96-3f01-4c71-994f-69059ca62986: rpc.has_security_group_logging(os_id): False [ 640.190781] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.209334] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.209535] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.209615] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.209822] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.209908] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.210456] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.210456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.210456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.210628] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.210628] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.210845] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.210918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.211034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.211131] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.211199] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.211397] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.212504] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.212504] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.212504] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.212504] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.212504] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fab5e96-3f01-4c71-994f-69059ca62986 is going to be created. [ 640.215667] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb31ec23-00b3-411e-81c7-83cd3eaa45d8: rpc.has_security_group_logging(os_id): False [ 640.231275] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.231347] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.231514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.232461] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.232461] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.232461] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.232461] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.232461] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.232461] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.232461] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.232461] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.232926] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.232926] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.232926] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.232926] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.233121] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.233121] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.233195] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.233296] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.233380] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.233444] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 is going to be created. [ 640.272410] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.272556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.272622] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.274260] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.274454] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.281353] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.281548] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.281632] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.281836] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.282020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.297359] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: IN_PROGRESS for 2s [ 640.298261] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 in Status: IN_PROGRESS for 2s [ 640.368917] env[69559]: INFO networking_nsxv3.common.synchronization [req-3cce2bdc-5b9c-4795-955a-46056bec4ce0 req-9ee7b54b-aac5-4a07-b038-96d9b4d56205 tempest-ImagesNegativeTestJSON-1157450433 tempest-ImagesNegativeTestJSON-1157450433-project-member] Enqueued Resource ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 with Priority: HIGHEST for action security_group_members [ 640.369797] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 with Priority: HIGHEST for action security_group_members [ 640.370141] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.370240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.370302] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.370555] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.370701] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.370796] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.370859] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.370997] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.372028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.372174] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.698385] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.749832] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-115 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.749832] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-115" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.749832] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-115" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.749832] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-115" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.749832] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.751303] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.751567] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.751942] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.752204] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.752507] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 640.752714] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.752906] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.754610] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.754610] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 640.754610] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.754610] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.776543] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.776543] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 640.776543] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.776543] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-115" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.776543] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-118532fe-174d-4403-adeb-61433e3042af taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.776543] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-118532fe-174d-4403-adeb-61433e3042af" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.776543] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-118532fe-174d-4403-adeb-61433e3042af" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.776543] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-118532fe-174d-4403-adeb-61433e3042af" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.776543] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('118532fe-174d-4403-adeb-61433e3042af',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.823868] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5e555cc-4bc4-4e59-b77f-deda078818fb in Status: SUCCESS [ 640.823868] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.877745] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.877745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.877745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.877745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.877745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.877745] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.877745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.877745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.877745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.877745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.877745] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 already deleted. [ 640.877745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.891779] env[69559]: INFO networking_nsxv3.common.synchronization [None req-3beb8b29-032c-4b35-ad5e-c73779d4e478 None None] Enqueued Resource ID: 71e71324-8cb1-476c-ad9a-7a6989d45c0c with Priority: HIGHEST for action port [ 640.892665] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71e71324-8cb1-476c-ad9a-7a6989d45c0c with Priority: HIGHEST for action port [ 640.893401] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-71e71324-8cb1-476c-ad9a-7a6989d45c0c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.895422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71e71324-8cb1-476c-ad9a-7a6989d45c0c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.895634] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71e71324-8cb1-476c-ad9a-7a6989d45c0c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.895997] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71e71324-8cb1-476c-ad9a-7a6989d45c0c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.899117] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71e71324-8cb1-476c-ad9a-7a6989d45c0c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.202069] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.202270] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.202378] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.202603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.202876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.202876] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fab5e96-3f01-4c71-994f-69059ca62986 is going to be updated. [ 641.238718] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.238948] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.238948] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.239299] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.239452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.247355] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: IN_PROGRESS for 2s [ 641.282788] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.283445] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.283445] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.283580] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.283800] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.283927] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 118532fe-174d-4403-adeb-61433e3042af not found, creating... [ 641.284228] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.286685] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.286885] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.287162] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.287336] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.287688] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.287856] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.287994] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.288257] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.288397] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.288547] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 118532fe-174d-4403-adeb-61433e3042af is going to be created. [ 641.313086] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.313324] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.313464] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.317094] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.317094] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.317094] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-118532fe-174d-4403-adeb-61433e3042af" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.375652] env[69559]: INFO networking_nsxv3.common.synchronization [None req-5acc3742-4f32-4c78-b5dc-7910b8ff6a8b None None] Enqueued Resource ID: ed9abf46-9933-45da-a7d5-956441fc55f1 with Priority: HIGHEST for action port [ 641.375652] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed9abf46-9933-45da-a7d5-956441fc55f1 with Priority: HIGHEST for action port [ 641.375652] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed9abf46-9933-45da-a7d5-956441fc55f1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.375652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed9abf46-9933-45da-a7d5-956441fc55f1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.375652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed9abf46-9933-45da-a7d5-956441fc55f1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.375918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed9abf46-9933-45da-a7d5-956441fc55f1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.375918] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed9abf46-9933-45da-a7d5-956441fc55f1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.399650] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71e71324-8cb1-476c-ad9a-7a6989d45c0c [ 641.399650] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.399650] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.399650] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.399886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.399991] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.400657] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71e71324-8cb1-476c-ad9a-7a6989d45c0c already deleted. [ 641.400657] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71e71324-8cb1-476c-ad9a-7a6989d45c0c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.878942] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed9abf46-9933-45da-a7d5-956441fc55f1 [ 641.878942] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.878942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.878942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.879662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.879662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.879662] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed9abf46-9933-45da-a7d5-956441fc55f1 already deleted. [ 641.879662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed9abf46-9933-45da-a7d5-956441fc55f1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.178460] env[69559]: INFO networking_nsxv3.common.synchronization [req-3cce2bdc-5b9c-4795-955a-46056bec4ce0 req-100e42d7-5bdc-4cca-89af-c05e092e0ef9 service nova] Enqueued Resource ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 with Priority: HIGHEST for action security_group_rules [ 642.178652] env[69559]: INFO networking_nsxv3.common.synchronization [req-3cce2bdc-5b9c-4795-955a-46056bec4ce0 req-100e42d7-5bdc-4cca-89af-c05e092e0ef9 service nova] Enqueued Resource ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 with Priority: HIGHEST for action security_group_members [ 642.178804] env[69559]: INFO networking_nsxv3.common.synchronization [req-3cce2bdc-5b9c-4795-955a-46056bec4ce0 req-100e42d7-5bdc-4cca-89af-c05e092e0ef9 service nova] Enqueued Resource ID: 118532fe-174d-4403-adeb-61433e3042af with Priority: HIGHEST for action port [ 642.179062] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 with Priority: HIGHEST for action security_group_rules [ 642.179192] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 with Priority: HIGHEST for action security_group_members [ 642.179324] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 118532fe-174d-4403-adeb-61433e3042af with Priority: HIGHEST for action port [ 642.179857] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.179981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.182150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.182370] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.182564] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.183656] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.183802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.183866] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.184017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.184250] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.184250] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.184333] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.184452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.184538] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.184627] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.188604] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-118532fe-174d-4403-adeb-61433e3042af taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.188604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-118532fe-174d-4403-adeb-61433e3042af" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.188604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-118532fe-174d-4403-adeb-61433e3042af" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.188604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-118532fe-174d-4403-adeb-61433e3042af" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.188604] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('118532fe-174d-4403-adeb-61433e3042af',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.288727] env[69559]: INFO networking_nsxv3.common.synchronization [None req-821d9a1c-7191-4d2e-b598-661ddbe4deac tempest-ServerActionsV293TestJSON-791060682 tempest-ServerActionsV293TestJSON-791060682-project-member] Enqueued Resource ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf with Priority: HIGHEST for action security_group_rules [ 642.289114] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf with Priority: HIGHEST for action security_group_rules [ 642.289287] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9bd39e16-65ec-4813-afc3-35754d24a5bf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.289414] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.289458] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.289702] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.289787] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9bd39e16-65ec-4813-afc3-35754d24a5bf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.315832] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: SUCCESS [ 642.316076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.316531] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.316756] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.316845] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.318434] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 in Status: SUCCESS [ 642.318609] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.390887] env[69559]: INFO networking_nsxv3.common.synchronization [None req-c376e7cd-90fa-49cb-a6f3-a62b87b7cf25 tempest-ServerActionsV293TestJSON-791060682 tempest-ServerActionsV293TestJSON-791060682-project-member] Enqueued Resource ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf with Priority: HIGHEST for action security_group_rules [ 642.391130] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf with Priority: HIGHEST for action security_group_rules [ 642.391431] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9bd39e16-65ec-4813-afc3-35754d24a5bf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.391534] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.689728] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.690877] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.691032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.691182] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 118532fe-174d-4403-adeb-61433e3042af with status ACTIVE [ 642.691416] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.691504] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.691542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.691785] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.691840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.691988] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.694667] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.694986] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.694986] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.695061] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.695303] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.695385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.695385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.695533] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.695597] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.695694] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 118532fe-174d-4403-adeb-61433e3042af is going to be updated. [ 642.718193] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.718342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.718464] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.718648] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.718794] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.718967] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-118532fe-174d-4403-adeb-61433e3042af" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.809137] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.810059] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.810059] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.810059] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.810059] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.810059] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf already deleted. [ 642.810059] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.810059] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.810421] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.810499] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9bd39e16-65ec-4813-afc3-35754d24a5bf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.820386] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.820498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.029234] env[69559]: INFO networking_nsxv3.common.synchronization [req-8b4e6fa9-b4b8-4329-8d0a-bb32013e12fe req-b00a3ba5-40e7-4b7f-8d90-0d647e5f5f9a tempest-MigrationsAdminTest-370955767 tempest-MigrationsAdminTest-370955767-project-member] Enqueued Resource ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 with Priority: HIGHEST for action security_group_members [ 643.029524] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 with Priority: HIGHEST for action security_group_members [ 643.029777] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.030672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.030748] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.031040] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.031215] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.031325] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.031387] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.031545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.031632] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.031834] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.202645] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.262759] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: SUCCESS [ 643.262759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.262759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.262759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.262759] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.262759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.262759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.262759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.262759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.262759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.262759] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.333542] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.333542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.333542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.333542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.333542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.333542] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf already deleted. [ 643.333542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.360307] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.360307] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.360307] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.360307] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.360307] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.360307] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.360307] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.360307] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.360307] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.360307] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 643.362350] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.362751] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.363217] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.363544] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 643.364315] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.365137] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.386021] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.386021] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 643.386021] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.386021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.386021] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-f7c9937f-4acf-4121-9777-6ef52e3013f2 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.386021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-f7c9937f-4acf-4121-9777-6ef52e3013f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.386021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-f7c9937f-4acf-4121-9777-6ef52e3013f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.386021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-f7c9937f-4acf-4121-9777-6ef52e3013f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.386021] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7c9937f-4acf-4121-9777-6ef52e3013f2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.536021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.536021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.536021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.536021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.536021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.536021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.536021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.536021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.536021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.536021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.536021] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 already deleted. [ 643.536021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.707826] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.707826] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.707826] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.707826] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.707826] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.707826] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 is going to be created. [ 643.728540] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.734020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.734020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.734020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.734020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.741910] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 in Status: UNINITIALIZED for 2s [ 643.766899] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.767156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.767156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.767367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.767525] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.767623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.767686] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.767834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.767918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.768033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.768160] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.768251] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.768309] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.768446] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.768580] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.768710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.768772] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.768916] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.768979] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.769032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.769112] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.891390] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.891390] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.891390] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.891974] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.891974] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.891974] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port f7c9937f-4acf-4121-9777-6ef52e3013f2 not found, creating... [ 643.892143] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.892263] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.892915] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.892915] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.892915] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.893180] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.893180] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.893281] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.893457] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.893590] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.894098] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: f7c9937f-4acf-4121-9777-6ef52e3013f2 is going to be created. [ 643.914743] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.914743] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.914743] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.915871] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.915871] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.916074] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-f7c9937f-4acf-4121-9777-6ef52e3013f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.271617] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fab5e96-3f01-4c71-994f-69059ca62986: rpc.has_security_group_logging(os_id): False [ 644.295663] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.295663] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.295663] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.297537] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.297537] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.297537] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.297537] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.297537] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.297537] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.297537] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.297537] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.298264] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.298475] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.300218] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.300218] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.300218] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.300218] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.300218] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.300218] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.300218] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.300218] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fab5e96-3f01-4c71-994f-69059ca62986 is going to be updated. [ 644.369109] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.369306] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.369375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.369701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.369771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.383199] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: IN_PROGRESS for 2s [ 644.741444] env[69559]: INFO networking_nsxv3.common.synchronization [req-8b4e6fa9-b4b8-4329-8d0a-bb32013e12fe req-5984c10c-3585-4b02-9050-b7c6e8147e63 service nova] Enqueued Resource ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 with Priority: HIGHEST for action security_group_rules [ 644.741815] env[69559]: INFO networking_nsxv3.common.synchronization [req-8b4e6fa9-b4b8-4329-8d0a-bb32013e12fe req-5984c10c-3585-4b02-9050-b7c6e8147e63 service nova] Enqueued Resource ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 with Priority: HIGHEST for action security_group_members [ 644.742163] env[69559]: INFO networking_nsxv3.common.synchronization [req-8b4e6fa9-b4b8-4329-8d0a-bb32013e12fe req-5984c10c-3585-4b02-9050-b7c6e8147e63 service nova] Enqueued Resource ID: f7c9937f-4acf-4121-9777-6ef52e3013f2 with Priority: HIGHEST for action port [ 644.743952] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 with Priority: HIGHEST for action security_group_rules [ 644.743952] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 with Priority: HIGHEST for action security_group_members [ 644.743952] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7c9937f-4acf-4121-9777-6ef52e3013f2 with Priority: HIGHEST for action port [ 644.744340] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.744618] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.745161] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.746858] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.746858] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.747521] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.747829] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.748027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.751525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.751525] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.751525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.751525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.751525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.751525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.751525] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.751525] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7c9937f-4acf-4121-9777-6ef52e3013f2 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.751525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7c9937f-4acf-4121-9777-6ef52e3013f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.751525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7c9937f-4acf-4121-9777-6ef52e3013f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.751525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7c9937f-4acf-4121-9777-6ef52e3013f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.751525] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7c9937f-4acf-4121-9777-6ef52e3013f2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.085806] env[69559]: INFO networking_nsxv3.common.synchronization [req-346bb862-b67b-406b-9dd1-6f76a98af375 req-82fe891d-3c99-4848-a0ad-567e51a12596 tempest-SecurityGroupRulesTestJSON-1047272370 tempest-SecurityGroupRulesTestJSON-1047272370-project-member] Enqueued Resource ID: 2fb96395-8746-4e27-8443-418348668166 with Priority: HIGHEST for action security_group_rules [ 645.086721] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fb96395-8746-4e27-8443-418348668166 with Priority: HIGHEST for action security_group_rules [ 645.087321] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fb96395-8746-4e27-8443-418348668166 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.087436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fb96395-8746-4e27-8443-418348668166" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.087548] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fb96395-8746-4e27-8443-418348668166" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.087968] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fb96395-8746-4e27-8443-418348668166" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.088114] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fb96395-8746-4e27-8443-418348668166',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.166636] env[69559]: INFO networking_nsxv3.common.synchronization [req-4d3e2553-e467-48c8-a6c6-dcd471e48ada req-e08fe4fe-1ab4-4eb2-b150-ee33b9cd43e9 tempest-VolumesAssistedSnapshotsTest-466925179 tempest-VolumesAssistedSnapshotsTest-466925179-project-member] Enqueued Resource ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe with Priority: HIGHEST for action security_group_members [ 645.167568] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe with Priority: HIGHEST for action security_group_members [ 645.167568] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-39b15e36-c638-4ca0-a065-67c76e8f79fe taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.167719] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.167719] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.168021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.169117] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.169117] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.169117] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.169117] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.169117] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.169117] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39b15e36-c638-4ca0-a065-67c76e8f79fe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.254328] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7c9937f-4acf-4121-9777-6ef52e3013f2 with status ACTIVE [ 645.254910] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.254910] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.254910] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.255994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.255994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.255994] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.255994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.255994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.255994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.255994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.255994] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.255994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.256305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.256305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.256305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.256383] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7c9937f-4acf-4121-9777-6ef52e3013f2 is going to be updated. [ 645.258887] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.260829] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.260925] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.280247] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.280527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.280527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.280654] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.280891] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.280954] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7c9937f-4acf-4121-9777-6ef52e3013f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.568543] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-324 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.570047] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-324" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.570407] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-324" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.570700] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-324" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.570860] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.571036] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.571160] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.571447] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.571607] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.571807] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 645.571974] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.572119] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.572234] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.572345] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 645.572449] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.572583] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.589301] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.589467] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 645.589608] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.589777] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-324" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.590132] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-896d7ca9-4b5e-40dd-b87d-37ebf45d2c11 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.590303] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-896d7ca9-4b5e-40dd-b87d-37ebf45d2c11" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.590425] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-896d7ca9-4b5e-40dd-b87d-37ebf45d2c11" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.590720] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-896d7ca9-4b5e-40dd-b87d-37ebf45d2c11" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.590954] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('896d7ca9-4b5e-40dd-b87d-37ebf45d2c11',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.609433] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.609769] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.609769] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.610584] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.610584] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.610584] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fb96395-8746-4e27-8443-418348668166 already deleted. [ 645.610584] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fb96395-8746-4e27-8443-418348668166" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.664520] env[69559]: INFO networking_nsxv3.common.synchronization [None req-a86569c3-359e-4c26-b54b-fcb4d147bf2b tempest-ServersWithSpecificFlavorTestJSON-1886354194 tempest-ServersWithSpecificFlavorTestJSON-1886354194-project-member] Enqueued Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGHEST for action security_group_rules [ 645.666460] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGHEST for action security_group_rules [ 645.666460] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.666460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.666460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.666460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.666460] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.672134] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.672134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.672134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.672134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.672134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.672134] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.672134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.672134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.672134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.672134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.672134] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe already deleted. [ 645.672134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.753162] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 in Status: SUCCESS [ 645.754290] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.754495] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.754735] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.755089] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.755690] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.755690] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.755690] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.755690] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.755690] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.758107] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.761839] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.808283] env[69559]: INFO networking_nsxv3.common.synchronization [None req-46ce2776-cc9b-4e5a-86bb-2f0d987a4876 tempest-ServersWithSpecificFlavorTestJSON-1886354194 tempest-ServersWithSpecificFlavorTestJSON-1886354194-project-member] Enqueued Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGHEST for action security_group_rules [ 645.808283] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGHEST for action security_group_rules [ 645.808283] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.808283] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.095974] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.095974] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.095974] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.095974] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.096414] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.096414] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 896d7ca9-4b5e-40dd-b87d-37ebf45d2c11 not found, creating... [ 646.096567] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.096731] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.096874] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.097337] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.097656] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.097897] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.098139] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.098312] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.098582] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.098772] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.098960] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 896d7ca9-4b5e-40dd-b87d-37ebf45d2c11 is going to be created. [ 646.119189] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.119546] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.119937] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.120324] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.120620] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.121385] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-896d7ca9-4b5e-40dd-b87d-37ebf45d2c11" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.187692] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.187985] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.188094] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.188288] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.188378] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.188476] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d already deleted. [ 646.188561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.188714] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.188862] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.188944] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.260772] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.260938] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.261769] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.262099] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.262295] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.262408] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.262476] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.262680] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.262744] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.262805] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.263143] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.263143] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.263143] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.263319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.263922] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.263922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.263922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.263922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.263922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.264127] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.264127] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.266047] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.266047] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.266047] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.266047] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.266047] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.266286] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 is going to be created. [ 646.289149] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.289417] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.289454] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.289665] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.290518] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.301865] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 in Status: UNINITIALIZED for 2s [ 646.395483] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: SUCCESS [ 646.395792] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.710137] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.711499] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.711499] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.711499] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.711798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.711798] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d already deleted. [ 646.711798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.766346] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6: rpc.has_security_group_logging(os_id): False [ 646.785132] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.785132] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.785132] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.785132] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.785132] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.785431] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.786046] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.786046] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.786046] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.786218] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.786326] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.786426] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.786486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.786638] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.786715] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.786947] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.787082] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.787177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.787341] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.787458] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.787524] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 is going to be created. [ 646.849192] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.849388] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.849501] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.849754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.849974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.853179] env[69559]: INFO networking_nsxv3.common.synchronization [req-4d3e2553-e467-48c8-a6c6-dcd471e48ada req-b3d0d680-7df8-4271-99eb-616fa5a7b29e service nova] Enqueued Resource ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe with Priority: HIGHEST for action security_group_rules [ 646.853394] env[69559]: INFO networking_nsxv3.common.synchronization [req-4d3e2553-e467-48c8-a6c6-dcd471e48ada req-b3d0d680-7df8-4271-99eb-616fa5a7b29e service nova] Enqueued Resource ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe with Priority: HIGHEST for action security_group_members [ 646.853558] env[69559]: INFO networking_nsxv3.common.synchronization [req-4d3e2553-e467-48c8-a6c6-dcd471e48ada req-b3d0d680-7df8-4271-99eb-616fa5a7b29e service nova] Enqueued Resource ID: 896d7ca9-4b5e-40dd-b87d-37ebf45d2c11 with Priority: HIGHEST for action port [ 646.854162] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe with Priority: HIGHEST for action security_group_rules [ 646.854348] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe with Priority: HIGHEST for action security_group_members [ 646.854514] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 896d7ca9-4b5e-40dd-b87d-37ebf45d2c11 with Priority: HIGHEST for action port [ 646.854841] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39b15e36-c638-4ca0-a065-67c76e8f79fe taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.854965] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.855064] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.855263] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.855340] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39b15e36-c638-4ca0-a065-67c76e8f79fe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.856240] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-39b15e36-c638-4ca0-a065-67c76e8f79fe taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.856398] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.856469] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.856641] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.856822] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.856928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.856995] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.857181] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.857265] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.857379] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39b15e36-c638-4ca0-a065-67c76e8f79fe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.858233] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-896d7ca9-4b5e-40dd-b87d-37ebf45d2c11 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.858345] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-896d7ca9-4b5e-40dd-b87d-37ebf45d2c11" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.858416] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-896d7ca9-4b5e-40dd-b87d-37ebf45d2c11" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.858577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-896d7ca9-4b5e-40dd-b87d-37ebf45d2c11" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.858656] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('896d7ca9-4b5e-40dd-b87d-37ebf45d2c11',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.862452] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 in Status: IN_PROGRESS for 2s [ 647.363070] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-39b15e36-c638-4ca0-a065-67c76e8f79fe taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.363372] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.363408] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39b15e36-c638-4ca0-a065-67c76e8f79fe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.367987] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 896d7ca9-4b5e-40dd-b87d-37ebf45d2c11 with status ACTIVE [ 647.367987] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.367987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.367987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.367987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.367987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.367987] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.367987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.367987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.367987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.367987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.368421] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.368421] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.368421] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.368709] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.368709] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.368709] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 896d7ca9-4b5e-40dd-b87d-37ebf45d2c11 is going to be updated. [ 647.389360] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.389542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.389601] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.389794] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.389928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.390106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-896d7ca9-4b5e-40dd-b87d-37ebf45d2c11" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.404574] env[69559]: INFO networking_nsxv3.common.synchronization [req-abdd57ca-9834-41d0-9464-cedfb9ab3d58 req-3bb89b08-f7fa-4c1d-b614-a71160cc303a tempest-DeleteServersAdminTestJSON-538287081 tempest-DeleteServersAdminTestJSON-538287081-project-admin] Enqueued Resource ID: b5e555cc-4bc4-4e59-b77f-deda078818fb with Priority: HIGHEST for action security_group_members [ 647.405137] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5e555cc-4bc4-4e59-b77f-deda078818fb with Priority: HIGHEST for action security_group_members [ 647.405459] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5e555cc-4bc4-4e59-b77f-deda078818fb taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.405582] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.405646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.405887] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.406071] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.406183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.406247] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.406420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.406511] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.406606] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5e555cc-4bc4-4e59-b77f-deda078818fb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.872242] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39b15e36-c638-4ca0-a065-67c76e8f79fe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.909030] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.909296] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.909607] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.909928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.910058] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.910286] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.910384] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.910454] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.911149] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.911149] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.911149] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5e555cc-4bc4-4e59-b77f-deda078818fb is going to be updated. [ 647.944588] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.944588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.944588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.944588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.944588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.957459] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5e555cc-4bc4-4e59-b77f-deda078818fb in Status: IN_PROGRESS for 2s [ 648.316832] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 in Status: SUCCESS [ 648.317132] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.317314] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.317542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.317743] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.317920] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.317992] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.318135] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.318234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.318326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.318437] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.381113] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.381113] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.381113] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.381113] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.381113] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.381113] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe is going to be created. [ 648.405019] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.405019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.405019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.405019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.405019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.413279] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe in Status: UNINITIALIZED for 2s [ 648.820794] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.820995] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.821107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.821347] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.821523] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.821627] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.821692] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.821845] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.821935] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.822039] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.822193] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.822934] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.822934] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.823290] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.823422] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.823530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.823621] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.823780] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.823915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.823990] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.824111] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.873206] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 in Status: SUCCESS [ 648.873257] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.326539] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7: rpc.has_security_group_logging(os_id): False [ 649.345258] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.345258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.345258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.345258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.345258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.345258] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.345258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.345258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.345258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.345258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.345258] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.345258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.345258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.345258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.345258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.345728] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.345728] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.345728] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.345728] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.345728] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.345728] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 is going to be created. [ 649.397985] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.398312] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.398312] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.399597] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.399985] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.411681] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 in Status: IN_PROGRESS for 2s [ 649.969443] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5e555cc-4bc4-4e59-b77f-deda078818fb in Status: SUCCESS [ 649.969443] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5e555cc-4bc4-4e59-b77f-deda078818fb deletion is rescheduled due to dependency. [ 649.969443] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.973485] env[69559]: INFO networking_nsxv3.common.synchronization [req-bca6efc1-b0d1-4f97-b752-c3c3ca6c12e1 req-2630b1c4-ab2b-4723-91d7-c332c8defa43 tempest-SecurityGroupRulesTestJSON-1047272370 tempest-SecurityGroupRulesTestJSON-1047272370-project-member] Enqueued Resource ID: 84bd00af-e14a-4d8a-9789-f363f0ff8519 with Priority: HIGHEST for action security_group_rules [ 649.974164] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84bd00af-e14a-4d8a-9789-f363f0ff8519 with Priority: HIGHEST for action security_group_rules [ 649.974510] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84bd00af-e14a-4d8a-9789-f363f0ff8519 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.974922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84bd00af-e14a-4d8a-9789-f363f0ff8519" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.974922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84bd00af-e14a-4d8a-9789-f363f0ff8519" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.975145] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84bd00af-e14a-4d8a-9789-f363f0ff8519" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.975482] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84bd00af-e14a-4d8a-9789-f363f0ff8519',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.425024] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe in Status: SUCCESS [ 650.425672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.425672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.425672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.425868] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.425997] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.426074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.426236] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.426321] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.426409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.426532] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39b15e36-c638-4ca0-a065-67c76e8f79fe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.495682] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.495918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.496068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.496326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.496436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.496565] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84bd00af-e14a-4d8a-9789-f363f0ff8519 already deleted. [ 650.496674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84bd00af-e14a-4d8a-9789-f363f0ff8519" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.928721] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39b15e36-c638-4ca0-a065-67c76e8f79fe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.432080] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 in Status: SUCCESS [ 651.432080] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.432080] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39b15e36-c638-4ca0-a065-67c76e8f79fe: rpc.has_security_group_logging(os_id): False [ 651.449856] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.449856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.449856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.449856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.449856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.449856] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.449856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.449856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.449856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.449856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.449856] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe is going to be created. [ 651.504284] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.504464] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.504505] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.505301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.505301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.515964] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe in Status: IN_PROGRESS for 2s [ 651.601445] env[69559]: INFO networking_nsxv3.common.synchronization [req-79c3a2ae-27ae-46a1-95d5-ab3e5fafe35d req-9bc918ca-6ffb-44f8-882a-61b956d5c6a9 tempest-SecurityGroupRulesTestJSON-1047272370 tempest-SecurityGroupRulesTestJSON-1047272370-project-member] Enqueued Resource ID: 84bd00af-e14a-4d8a-9789-f363f0ff8519 with Priority: HIGHEST for action security_group_rules [ 651.602191] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84bd00af-e14a-4d8a-9789-f363f0ff8519 with Priority: HIGHEST for action security_group_rules [ 651.602796] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84bd00af-e14a-4d8a-9789-f363f0ff8519 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.603144] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84bd00af-e14a-4d8a-9789-f363f0ff8519" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.603640] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84bd00af-e14a-4d8a-9789-f363f0ff8519" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.604067] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84bd00af-e14a-4d8a-9789-f363f0ff8519" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.604316] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84bd00af-e14a-4d8a-9789-f363f0ff8519',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.128710] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.128710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.128710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.128710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.128710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.128710] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84bd00af-e14a-4d8a-9789-f363f0ff8519 already deleted. [ 652.128710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84bd00af-e14a-4d8a-9789-f363f0ff8519" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.528956] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe in Status: SUCCESS [ 653.529245] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.117801] env[69559]: INFO networking_nsxv3.common.synchronization [None req-6d5a65c4-6aac-41b6-827d-ac20f6b44118 None None] Enqueued Resource ID: ef4fe4a8-b0f0-41fb-afdd-28fd945e11a7 with Priority: HIGHEST for action port [ 654.118447] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef4fe4a8-b0f0-41fb-afdd-28fd945e11a7 with Priority: HIGHEST for action port [ 654.118913] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef4fe4a8-b0f0-41fb-afdd-28fd945e11a7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.120440] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef4fe4a8-b0f0-41fb-afdd-28fd945e11a7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.121172] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef4fe4a8-b0f0-41fb-afdd-28fd945e11a7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.121172] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef4fe4a8-b0f0-41fb-afdd-28fd945e11a7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.122387] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef4fe4a8-b0f0-41fb-afdd-28fd945e11a7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.625909] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef4fe4a8-b0f0-41fb-afdd-28fd945e11a7 [ 654.626214] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.626525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.626636] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.627258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.627472] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.627590] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef4fe4a8-b0f0-41fb-afdd-28fd945e11a7 already deleted. [ 654.627685] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef4fe4a8-b0f0-41fb-afdd-28fd945e11a7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.746233] env[69559]: INFO networking_nsxv3.common.synchronization [req-b02db942-64d8-4442-bca6-2fce4774b67b req-6b7561b2-0efc-4226-84e2-967e7ebafd9a tempest-ServerDiagnosticsNegativeTest-2008506713 tempest-ServerDiagnosticsNegativeTest-2008506713-project-member] Enqueued Resource ID: 54038215-926d-4af7-820c-4eb952c9aac0 with Priority: HIGHEST for action security_group_members [ 654.746561] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54038215-926d-4af7-820c-4eb952c9aac0 with Priority: HIGHEST for action security_group_members [ 654.746986] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-54038215-926d-4af7-820c-4eb952c9aac0 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.747845] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.747845] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.747845] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.747845] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.747845] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.747845] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.748151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.748151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.748151] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54038215-926d-4af7-820c-4eb952c9aac0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.258328] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.258328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.258328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.258328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.258328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.258328] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.258328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.258328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.258328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.258328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.258328] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54038215-926d-4af7-820c-4eb952c9aac0 already deleted. [ 655.258328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.404136] env[69559]: INFO networking_nsxv3.common.synchronization [req-d87fa800-a547-4159-9881-8431cc7ef637 req-1f793cb1-200d-47e7-b97e-c80bd68885a4 tempest-SecurityGroupRulesTestJSON-1047272370 tempest-SecurityGroupRulesTestJSON-1047272370-project-member] Enqueued Resource ID: 84bd00af-e14a-4d8a-9789-f363f0ff8519 with Priority: HIGHEST for action security_group_rules [ 655.407140] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84bd00af-e14a-4d8a-9789-f363f0ff8519 with Priority: HIGHEST for action security_group_rules [ 655.407229] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84bd00af-e14a-4d8a-9789-f363f0ff8519 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.407356] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84bd00af-e14a-4d8a-9789-f363f0ff8519" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.408436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84bd00af-e14a-4d8a-9789-f363f0ff8519" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.408436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84bd00af-e14a-4d8a-9789-f363f0ff8519" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.408436] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84bd00af-e14a-4d8a-9789-f363f0ff8519',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.416849] env[69559]: INFO networking_nsxv3.common.synchronization [req-e5c689fc-6cec-4b36-b289-10b0e431c6d3 req-db588dc1-abfe-42d3-acf6-aed5ceebfbe8 tempest-ServerExternalEventsTest-1068033534 tempest-ServerExternalEventsTest-1068033534-project-member] Enqueued Resource ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 with Priority: HIGHEST for action security_group_members [ 655.417405] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 with Priority: HIGHEST for action security_group_members [ 655.417746] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.418173] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.418173] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.418811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.418811] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.418811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.418811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.419841] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.419841] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.419841] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb31ec23-00b3-411e-81c7-83cd3eaa45d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.460410] env[69559]: INFO networking_nsxv3.common.synchronization [None req-06221eff-83da-478a-aa2b-02a28077d0a3 None None] Enqueued Resource ID: 4744aea2-23e5-4188-a5f2-6777071147cb with Priority: HIGHEST for action port [ 655.460410] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4744aea2-23e5-4188-a5f2-6777071147cb with Priority: HIGHEST for action port [ 655.462280] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-4744aea2-23e5-4188-a5f2-6777071147cb taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.462466] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4744aea2-23e5-4188-a5f2-6777071147cb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.462466] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4744aea2-23e5-4188-a5f2-6777071147cb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.462807] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4744aea2-23e5-4188-a5f2-6777071147cb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.462908] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4744aea2-23e5-4188-a5f2-6777071147cb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.802525] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.802848] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.803166] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.803251] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.803492] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.803650] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.803767] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.804104] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.805417] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.805729] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 655.805997] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 655.806217] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 655.806394] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 655.808491] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 655.808491] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 655.808491] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.828424] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.828538] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 655.829420] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.829420] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.829420] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-70b04838-908b-4a90-9076-91f79f190ed3 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.829620] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-70b04838-908b-4a90-9076-91f79f190ed3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.829699] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-70b04838-908b-4a90-9076-91f79f190ed3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.830735] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-70b04838-908b-4a90-9076-91f79f190ed3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.830929] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70b04838-908b-4a90-9076-91f79f190ed3',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.921512] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.921693] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.921731] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.921942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.922053] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.922275] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.922381] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.922441] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.922591] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.922675] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.922758] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 is going to be updated. [ 655.926475] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.926595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.926660] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.926866] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.926933] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.927032] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84bd00af-e14a-4d8a-9789-f363f0ff8519 already deleted. [ 655.927121] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84bd00af-e14a-4d8a-9789-f363f0ff8519" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.946309] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.946505] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.946505] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.946732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.947030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.954712] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 in Status: IN_PROGRESS for 2s [ 655.967066] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4744aea2-23e5-4188-a5f2-6777071147cb [ 655.967319] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.967452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.967520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.967726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.967823] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.967963] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4744aea2-23e5-4188-a5f2-6777071147cb already deleted. [ 655.968076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4744aea2-23e5-4188-a5f2-6777071147cb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.190358] env[69559]: INFO networking_nsxv3.common.synchronization [None req-543d7953-85de-44f8-af3d-53195a3207eb None None] Enqueued Resource ID: 6c45e743-8f31-44c5-9110-37ca3a405442 with Priority: HIGHEST for action port [ 656.190950] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c45e743-8f31-44c5-9110-37ca3a405442 with Priority: HIGHEST for action port [ 656.191272] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c45e743-8f31-44c5-9110-37ca3a405442 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.191390] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c45e743-8f31-44c5-9110-37ca3a405442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.191498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c45e743-8f31-44c5-9110-37ca3a405442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.191700] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c45e743-8f31-44c5-9110-37ca3a405442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.191777] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c45e743-8f31-44c5-9110-37ca3a405442',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.333161] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.334408] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.334408] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.334408] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.334408] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.334408] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 70b04838-908b-4a90-9076-91f79f190ed3 not found, creating... [ 656.334408] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.335289] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.335289] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.335289] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.335289] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.335289] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.335458] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.335566] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.335750] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.335883] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.337181] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 70b04838-908b-4a90-9076-91f79f190ed3 is going to be created. [ 656.360633] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.360919] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.360985] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.361301] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.361704] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.361782] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-70b04838-908b-4a90-9076-91f79f190ed3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.405608] env[69559]: INFO networking_nsxv3.common.synchronization [req-43bf2fd4-73fd-442b-8eaa-3058f45f6491 req-ef41b410-f5d0-4d08-a717-e7e5c9e84b07 tempest-ImagesNegativeTestJSON-1157450433 tempest-ImagesNegativeTestJSON-1157450433-project-member] Enqueued Resource ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 with Priority: HIGHEST for action security_group_members [ 656.406301] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 with Priority: HIGHEST for action security_group_members [ 656.406847] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.407123] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.407445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.407707] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.408098] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.408300] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.409281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.409561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.409734] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.409903] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.696501] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c45e743-8f31-44c5-9110-37ca3a405442 [ 656.696501] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.696501] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.696631] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.696906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.696906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.697038] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c45e743-8f31-44c5-9110-37ca3a405442 already deleted. [ 656.697038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c45e743-8f31-44c5-9110-37ca3a405442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.916166] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.916447] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.916447] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.916784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.916784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.916922] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.917065] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.917116] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.917278] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.917356] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.918206] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 is going to be updated. [ 656.946237] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.946398] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.946474] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.946689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.946835] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.955967] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 in Status: IN_PROGRESS for 2s [ 657.894169] env[69559]: INFO networking_nsxv3.common.synchronization [req-b02db942-64d8-4442-bca6-2fce4774b67b req-7c264a71-2948-4441-894b-cc5962f1d6bb service nova] Enqueued Resource ID: 54038215-926d-4af7-820c-4eb952c9aac0 with Priority: HIGHEST for action security_group_rules [ 657.895032] env[69559]: INFO networking_nsxv3.common.synchronization [req-b02db942-64d8-4442-bca6-2fce4774b67b req-7c264a71-2948-4441-894b-cc5962f1d6bb service nova] Enqueued Resource ID: 54038215-926d-4af7-820c-4eb952c9aac0 with Priority: HIGHEST for action security_group_members [ 657.895032] env[69559]: INFO networking_nsxv3.common.synchronization [req-b02db942-64d8-4442-bca6-2fce4774b67b req-7c264a71-2948-4441-894b-cc5962f1d6bb service nova] Enqueued Resource ID: 70b04838-908b-4a90-9076-91f79f190ed3 with Priority: HIGHEST for action port [ 657.895032] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54038215-926d-4af7-820c-4eb952c9aac0 with Priority: HIGHEST for action security_group_rules [ 657.895032] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54038215-926d-4af7-820c-4eb952c9aac0 with Priority: HIGHEST for action security_group_members [ 657.895032] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70b04838-908b-4a90-9076-91f79f190ed3 with Priority: HIGHEST for action port [ 657.895507] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54038215-926d-4af7-820c-4eb952c9aac0 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.895636] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.895703] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.895959] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.897293] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54038215-926d-4af7-820c-4eb952c9aac0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.899090] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-54038215-926d-4af7-820c-4eb952c9aac0 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.903124] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.903228] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.903398] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.903641] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.903705] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.903747] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.903867] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.903959] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.904089] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54038215-926d-4af7-820c-4eb952c9aac0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.905095] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-70b04838-908b-4a90-9076-91f79f190ed3 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.905262] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70b04838-908b-4a90-9076-91f79f190ed3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.905339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70b04838-908b-4a90-9076-91f79f190ed3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.905811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70b04838-908b-4a90-9076-91f79f190ed3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.905811] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70b04838-908b-4a90-9076-91f79f190ed3',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.966242] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 in Status: SUCCESS [ 657.966541] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 deletion is rescheduled due to dependency. [ 657.966579] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.246334] env[69559]: INFO networking_nsxv3.common.synchronization [req-f2126827-f783-4efa-87cc-46284e4a0b83 req-58a8a33f-90be-468b-9ccd-27bd01d3df66 tempest-ServersAdminNegativeTestJSON-256921676 tempest-ServersAdminNegativeTestJSON-256921676-project-member] Enqueued Resource ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe with Priority: HIGHEST for action security_group_members [ 658.250276] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe with Priority: HIGHEST for action security_group_members [ 658.250276] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6bb8723-4212-49f6-9e0f-6762cf861cbe taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.250276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.250276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.250276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.250276] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.250276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.250276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.250276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.250276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.250276] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6bb8723-4212-49f6-9e0f-6762cf861cbe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.407298] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54038215-926d-4af7-820c-4eb952c9aac0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.409292] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-54038215-926d-4af7-820c-4eb952c9aac0 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.409292] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.417322] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70b04838-908b-4a90-9076-91f79f190ed3 with status ACTIVE [ 658.417322] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.417322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.417322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.417322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.417322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.417322] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.417322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.417322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.417322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.417322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.417322] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.417322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.417322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.417322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.417322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.417322] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70b04838-908b-4a90-9076-91f79f190ed3 is going to be updated. [ 658.463283] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.463534] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.463534] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.463773] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.463942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.464163] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70b04838-908b-4a90-9076-91f79f190ed3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.746309] env[69559]: INFO networking_nsxv3.common.synchronization [None req-6f586c80-a742-46a8-a8de-041f9b062507 None None] Enqueued Resource ID: f1c2ed46-dd09-45fa-baf4-6c732a573d93 with Priority: HIGHEST for action port [ 658.746309] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1c2ed46-dd09-45fa-baf4-6c732a573d93 with Priority: HIGHEST for action port [ 658.746309] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1c2ed46-dd09-45fa-baf4-6c732a573d93 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.746309] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1c2ed46-dd09-45fa-baf4-6c732a573d93" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.746309] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1c2ed46-dd09-45fa-baf4-6c732a573d93" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.746309] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1c2ed46-dd09-45fa-baf4-6c732a573d93" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.746309] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1c2ed46-dd09-45fa-baf4-6c732a573d93',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.755668] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.755668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.755668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.755668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.755668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.755668] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.755668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.755668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.755668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.755668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.755668] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe already deleted. [ 658.755668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.870058] env[69559]: INFO networking_nsxv3.common.synchronization [None req-5982cfd3-e58b-47cd-972e-1c1fd64ec2a1 None None] Enqueued Resource ID: c2dd3086-c93d-4509-a3bc-8f2cd75e3ca2 with Priority: HIGHEST for action port [ 658.870171] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2dd3086-c93d-4509-a3bc-8f2cd75e3ca2 with Priority: HIGHEST for action port [ 658.870702] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2dd3086-c93d-4509-a3bc-8f2cd75e3ca2 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.870823] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2dd3086-c93d-4509-a3bc-8f2cd75e3ca2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.870891] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2dd3086-c93d-4509-a3bc-8f2cd75e3ca2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.871182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2dd3086-c93d-4509-a3bc-8f2cd75e3ca2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.871265] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2dd3086-c93d-4509-a3bc-8f2cd75e3ca2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.911151] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54038215-926d-4af7-820c-4eb952c9aac0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.966345] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 in Status: SUCCESS [ 658.966345] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 deletion is rescheduled due to dependency. [ 658.966345] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.086802] env[69559]: INFO networking_nsxv3.common.synchronization [None req-84bb60cc-a7c5-4e0a-a5b1-74ef40063c5b None None] Enqueued Resource ID: ff3c58d8-8ae9-4d25-a094-62b0b728045a with Priority: HIGHEST for action port [ 659.087378] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff3c58d8-8ae9-4d25-a094-62b0b728045a with Priority: HIGHEST for action port [ 659.088349] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff3c58d8-8ae9-4d25-a094-62b0b728045a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.088349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff3c58d8-8ae9-4d25-a094-62b0b728045a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.088349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff3c58d8-8ae9-4d25-a094-62b0b728045a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.090170] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff3c58d8-8ae9-4d25-a094-62b0b728045a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.090287] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff3c58d8-8ae9-4d25-a094-62b0b728045a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.249395] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1c2ed46-dd09-45fa-baf4-6c732a573d93 [ 659.249395] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.249395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.249395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.249395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.249395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.249395] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1c2ed46-dd09-45fa-baf4-6c732a573d93 already deleted. [ 659.249395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1c2ed46-dd09-45fa-baf4-6c732a573d93" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.255022] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.255022] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.255022] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.255803] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.259044] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.259044] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.259044] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.259044] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.259044] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.259044] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.259044] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.259044] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.259044] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.259044] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.259044] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.259044] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.279246] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.279432] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 659.279664] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.279875] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.280094] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-0b692245-4c29-4368-bb90-d0265f12b7c3 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.280346] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-0b692245-4c29-4368-bb90-d0265f12b7c3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.280406] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-0b692245-4c29-4368-bb90-d0265f12b7c3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.280734] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-0b692245-4c29-4368-bb90-d0265f12b7c3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.280874] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b692245-4c29-4368-bb90-d0265f12b7c3',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.375389] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2dd3086-c93d-4509-a3bc-8f2cd75e3ca2 [ 659.375628] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.375751] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.377528] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.377528] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.377528] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.377528] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2dd3086-c93d-4509-a3bc-8f2cd75e3ca2 already deleted. [ 659.377528] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2dd3086-c93d-4509-a3bc-8f2cd75e3ca2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.415011] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.415011] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.415011] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.415011] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.415011] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.415011] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54038215-926d-4af7-820c-4eb952c9aac0 is going to be created. [ 659.439319] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.439319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.439319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.439319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.439319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.451566] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54038215-926d-4af7-820c-4eb952c9aac0 in Status: UNINITIALIZED for 2s [ 659.593799] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff3c58d8-8ae9-4d25-a094-62b0b728045a [ 659.593799] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.593799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.593799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.593799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.593799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.593799] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff3c58d8-8ae9-4d25-a094-62b0b728045a already deleted. [ 659.593799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff3c58d8-8ae9-4d25-a094-62b0b728045a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.783342] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.783564] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.783720] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.784065] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.784239] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.784394] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 0b692245-4c29-4368-bb90-d0265f12b7c3 not found, creating... [ 659.784659] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.784966] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.785065] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.788226] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.788226] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.788226] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.788226] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.788226] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.788226] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.788226] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.788226] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 0b692245-4c29-4368-bb90-d0265f12b7c3 is going to be created. [ 659.808299] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.808525] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.808650] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.808923] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.809202] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.809434] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-0b692245-4c29-4368-bb90-d0265f12b7c3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.417952] env[69559]: INFO networking_nsxv3.common.synchronization [req-e713b308-a9c9-4d93-83cd-51dad2df1f46 req-b8dc0cab-cc35-4f9c-b938-e608d0541116 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 660.418372] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 660.418649] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.418775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.418840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.420187] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.421625] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.421625] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.421625] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.421625] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.421625] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.421625] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.923689] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.923689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.923689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.923689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.923689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.924111] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.924111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.924111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.924296] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.924400] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.924507] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 already deleted. [ 660.924612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.295584] env[69559]: INFO networking_nsxv3.common.synchronization [None req-144261d1-224f-4d4a-a0e6-9a3b24dec23c None None] Enqueued Resource ID: 8058fd36-0a75-4312-abb3-618c0d8ca7f8 with Priority: HIGHEST for action port [ 661.295856] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8058fd36-0a75-4312-abb3-618c0d8ca7f8 with Priority: HIGHEST for action port [ 661.296482] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-8058fd36-0a75-4312-abb3-618c0d8ca7f8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.296547] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8058fd36-0a75-4312-abb3-618c0d8ca7f8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.296617] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8058fd36-0a75-4312-abb3-618c0d8ca7f8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.296857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8058fd36-0a75-4312-abb3-618c0d8ca7f8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.297580] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8058fd36-0a75-4312-abb3-618c0d8ca7f8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.465230] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54038215-926d-4af7-820c-4eb952c9aac0 in Status: SUCCESS [ 661.465533] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.465837] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.465943] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.466203] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.466386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.466471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.466812] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.466812] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.467417] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.467417] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54038215-926d-4af7-820c-4eb952c9aac0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.802263] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8058fd36-0a75-4312-abb3-618c0d8ca7f8 [ 661.802567] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.802708] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.802777] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.802990] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.803168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.803269] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8058fd36-0a75-4312-abb3-618c0d8ca7f8 already deleted. [ 661.803359] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8058fd36-0a75-4312-abb3-618c0d8ca7f8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.968199] env[69559]: INFO networking_nsxv3.common.synchronization [None req-90e2dbf3-ee4f-4f0a-819d-def88a0d2f93 None None] Enqueued Resource ID: 94e79667-0aff-4890-8c33-ef6b447674d2 with Priority: HIGHEST for action port [ 661.968199] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94e79667-0aff-4890-8c33-ef6b447674d2 with Priority: HIGHEST for action port [ 661.968199] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-94e79667-0aff-4890-8c33-ef6b447674d2 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.968199] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94e79667-0aff-4890-8c33-ef6b447674d2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.968199] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94e79667-0aff-4890-8c33-ef6b447674d2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.968199] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94e79667-0aff-4890-8c33-ef6b447674d2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.968199] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94e79667-0aff-4890-8c33-ef6b447674d2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.972285] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-54038215-926d-4af7-820c-4eb952c9aac0 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.972409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.972477] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.972681] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.972842] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.972941] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.973015] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.974200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.974200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.974200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.974200] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-54038215-926d-4af7-820c-4eb952c9aac0 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.974200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.974200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.974200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.974904] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.974904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.974904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.974904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.974904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.974904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.974904] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54038215-926d-4af7-820c-4eb952c9aac0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.108110] env[69559]: INFO networking_nsxv3.common.synchronization [req-f2126827-f783-4efa-87cc-46284e4a0b83 req-2d679313-b72d-42f9-b556-875b86ebfd8f service nova] Enqueued Resource ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe with Priority: HIGHEST for action security_group_rules [ 662.108110] env[69559]: INFO networking_nsxv3.common.synchronization [req-f2126827-f783-4efa-87cc-46284e4a0b83 req-2d679313-b72d-42f9-b556-875b86ebfd8f service nova] Enqueued Resource ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe with Priority: HIGHEST for action security_group_members [ 662.108110] env[69559]: INFO networking_nsxv3.common.synchronization [req-f2126827-f783-4efa-87cc-46284e4a0b83 req-2d679313-b72d-42f9-b556-875b86ebfd8f service nova] Enqueued Resource ID: 0b692245-4c29-4368-bb90-d0265f12b7c3 with Priority: HIGHEST for action port [ 662.108110] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe with Priority: HIGHEST for action security_group_rules [ 662.108630] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe with Priority: HIGHEST for action security_group_members [ 662.110782] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b692245-4c29-4368-bb90-d0265f12b7c3 with Priority: HIGHEST for action port [ 662.110782] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6bb8723-4212-49f6-9e0f-6762cf861cbe taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.110782] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.110782] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.110782] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.110782] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6bb8723-4212-49f6-9e0f-6762cf861cbe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.111249] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6bb8723-4212-49f6-9e0f-6762cf861cbe taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.111249] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.111249] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.111506] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.111860] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.111860] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.111860] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.112104] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.112220] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.112340] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6bb8723-4212-49f6-9e0f-6762cf861cbe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.113308] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b692245-4c29-4368-bb90-d0265f12b7c3 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.113449] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b692245-4c29-4368-bb90-d0265f12b7c3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.113542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b692245-4c29-4368-bb90-d0265f12b7c3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.113712] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b692245-4c29-4368-bb90-d0265f12b7c3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.113814] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b692245-4c29-4368-bb90-d0265f12b7c3',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.183495] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.183495] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-547" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.183495] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-547" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.183495] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-547" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.183844] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.183959] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.184196] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.184396] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.184546] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.184791] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 662.184930] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.185055] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.185174] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.185291] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 662.185399] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.185535] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.203268] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.203482] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 662.203615] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.203809] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-547" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.204195] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-75a0cbae-2863-40ba-a7fe-e0407e9c8c5a taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.204398] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-75a0cbae-2863-40ba-a7fe-e0407e9c8c5a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.204522] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-75a0cbae-2863-40ba-a7fe-e0407e9c8c5a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.204864] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-75a0cbae-2863-40ba-a7fe-e0407e9c8c5a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.206510] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75a0cbae-2863-40ba-a7fe-e0407e9c8c5a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.471425] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94e79667-0aff-4890-8c33-ef6b447674d2 [ 662.471704] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.471804] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.471874] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.472167] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.472262] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.472355] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94e79667-0aff-4890-8c33-ef6b447674d2 already deleted. [ 662.472436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94e79667-0aff-4890-8c33-ef6b447674d2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.476818] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54038215-926d-4af7-820c-4eb952c9aac0: rpc.has_security_group_logging(os_id): False [ 662.494660] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.494818] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.494922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.495107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.495210] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.495406] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.495538] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.495616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.495742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.495819] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.496027] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.496113] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.496300] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.496300] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.496387] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.496752] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.496752] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.496752] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.496969] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.496969] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.497100] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54038215-926d-4af7-820c-4eb952c9aac0 is going to be created. [ 662.516617] env[69559]: INFO networking_nsxv3.common.synchronization [req-46a64bd7-31b1-43c0-be50-8b3e6114ace0 req-7098a70c-5822-419e-b8f2-7a859235193e tempest-ListImageFiltersTestJSON-342177122 tempest-ListImageFiltersTestJSON-342177122-project-member] Enqueued Resource ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 with Priority: HIGHEST for action security_group_members [ 662.516617] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 with Priority: HIGHEST for action security_group_members [ 662.516617] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.516617] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.516617] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.516617] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.516617] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.516617] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.517418] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.517418] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.517418] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.517418] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d3ab8f7-3874-4370-9e84-4a90ecd908d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.531244] env[69559]: INFO networking_nsxv3.common.synchronization [None req-9a04ba7a-eecd-4846-b98a-f5eb5b148e14 None None] Enqueued Resource ID: 8dc84fbc-0158-4c78-87bb-6d39038b7b37 with Priority: HIGHEST for action port [ 662.531582] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dc84fbc-0158-4c78-87bb-6d39038b7b37 with Priority: HIGHEST for action port [ 662.532096] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dc84fbc-0158-4c78-87bb-6d39038b7b37 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.532222] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dc84fbc-0158-4c78-87bb-6d39038b7b37" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.532291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dc84fbc-0158-4c78-87bb-6d39038b7b37" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.532997] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dc84fbc-0158-4c78-87bb-6d39038b7b37" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.533105] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dc84fbc-0158-4c78-87bb-6d39038b7b37',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.557022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.557022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.557022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.557022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.557022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.570802] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54038215-926d-4af7-820c-4eb952c9aac0 in Status: IN_PROGRESS for 2s [ 662.616437] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6bb8723-4212-49f6-9e0f-6762cf861cbe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.617156] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6bb8723-4212-49f6-9e0f-6762cf861cbe taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.617294] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.621887] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b692245-4c29-4368-bb90-d0265f12b7c3 with status ACTIVE [ 662.621887] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.621887] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.621887] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.624211] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.624211] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.624211] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.624211] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.624211] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.624211] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.624211] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.624211] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.624211] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.624211] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.628758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.628758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.628758] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b692245-4c29-4368-bb90-d0265f12b7c3 is going to be updated. [ 662.648385] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.648529] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.648598] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.648819] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.648950] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.649126] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b692245-4c29-4368-bb90-d0265f12b7c3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.714733] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.714984] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.715422] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.715422] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.715671] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.715875] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 75a0cbae-2863-40ba-a7fe-e0407e9c8c5a not found, creating... [ 662.716228] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.716415] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.716536] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.716818] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.717010] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.717330] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.717487] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.717601] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.717817] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.717971] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.718205] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 75a0cbae-2863-40ba-a7fe-e0407e9c8c5a is going to be created. [ 662.756434] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.757052] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.757052] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.757293] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.757615] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.757836] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-75a0cbae-2863-40ba-a7fe-e0407e9c8c5a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.020069] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.020456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.020581] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.020874] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.021153] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.021402] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.021582] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.021776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.021932] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.021979] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.022149] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 already deleted. [ 663.022149] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.035584] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8dc84fbc-0158-4c78-87bb-6d39038b7b37 [ 663.035801] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.035926] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.035996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.036206] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.036292] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.036381] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8dc84fbc-0158-4c78-87bb-6d39038b7b37 already deleted. [ 663.036459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dc84fbc-0158-4c78-87bb-6d39038b7b37" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.121398] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6bb8723-4212-49f6-9e0f-6762cf861cbe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.220509] env[69559]: INFO networking_nsxv3.common.synchronization [None req-ce722c9b-b04c-4ae6-9870-26cc724d5011 None None] Enqueued Resource ID: 1862572b-c65e-4a18-9411-3475eeb1e42c with Priority: HIGHEST for action port [ 663.220771] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1862572b-c65e-4a18-9411-3475eeb1e42c with Priority: HIGHEST for action port [ 663.221368] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-1862572b-c65e-4a18-9411-3475eeb1e42c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.221511] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1862572b-c65e-4a18-9411-3475eeb1e42c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.221589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1862572b-c65e-4a18-9411-3475eeb1e42c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.221918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1862572b-c65e-4a18-9411-3475eeb1e42c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.221918] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1862572b-c65e-4a18-9411-3475eeb1e42c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.318181] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.318181] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.318181] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.318181] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.318181] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.318866] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.319013] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.319298] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.319451] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.319683] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 663.319808] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 663.319920] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 663.320043] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 663.320304] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 663.320304] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 663.320578] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 663.341658] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 663.341829] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 663.341969] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 663.342169] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.342525] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-28e30bbf-507e-47f2-9636-675860041f7b taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.342708] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-28e30bbf-507e-47f2-9636-675860041f7b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.344376] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-28e30bbf-507e-47f2-9636-675860041f7b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.344376] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-28e30bbf-507e-47f2-9636-675860041f7b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.344376] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28e30bbf-507e-47f2-9636-675860041f7b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.624206] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.624743] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.624743] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.624743] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.624743] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.626119] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe is going to be created. [ 663.647416] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.647570] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.647642] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.647852] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.648103] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.656547] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe in Status: UNINITIALIZED for 2s [ 663.727596] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1862572b-c65e-4a18-9411-3475eeb1e42c [ 663.727596] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.727596] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.727596] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.728140] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.728140] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.728140] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1862572b-c65e-4a18-9411-3475eeb1e42c already deleted. [ 663.728140] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1862572b-c65e-4a18-9411-3475eeb1e42c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.849137] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.849429] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.849583] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.849888] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.850087] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.851252] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 28e30bbf-507e-47f2-9636-675860041f7b not found, creating... [ 663.851604] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.851786] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.851913] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.852199] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.852360] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.853019] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.853019] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.853153] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.853284] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.853447] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.853576] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 28e30bbf-507e-47f2-9636-675860041f7b is going to be created. [ 663.874634] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.874634] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.874634] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.874634] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.874634] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.874634] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-28e30bbf-507e-47f2-9636-675860041f7b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.123287] env[69559]: INFO networking_nsxv3.common.synchronization [None req-63785285-ef2c-4e68-b275-87a7980dc38b None None] Enqueued Resource ID: 91c579b7-248b-45d7-a285-fe3d62562362 with Priority: HIGHEST for action port [ 664.123287] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91c579b7-248b-45d7-a285-fe3d62562362 with Priority: HIGHEST for action port [ 664.123287] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-91c579b7-248b-45d7-a285-fe3d62562362 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.123287] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91c579b7-248b-45d7-a285-fe3d62562362" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.123287] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91c579b7-248b-45d7-a285-fe3d62562362" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.123287] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91c579b7-248b-45d7-a285-fe3d62562362" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.123287] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91c579b7-248b-45d7-a285-fe3d62562362',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.490504] env[69559]: INFO networking_nsxv3.common.synchronization [req-e713b308-a9c9-4d93-83cd-51dad2df1f46 req-bc89dba5-2f8e-4a58-bb75-4ab0509949ab service nova] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_rules [ 664.490764] env[69559]: INFO networking_nsxv3.common.synchronization [req-e713b308-a9c9-4d93-83cd-51dad2df1f46 req-bc89dba5-2f8e-4a58-bb75-4ab0509949ab service nova] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 664.490988] env[69559]: INFO networking_nsxv3.common.synchronization [req-e713b308-a9c9-4d93-83cd-51dad2df1f46 req-bc89dba5-2f8e-4a58-bb75-4ab0509949ab service nova] Enqueued Resource ID: 75a0cbae-2863-40ba-a7fe-e0407e9c8c5a with Priority: HIGHEST for action port [ 664.491264] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_rules [ 664.491488] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 664.491537] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75a0cbae-2863-40ba-a7fe-e0407e9c8c5a with Priority: HIGHEST for action port [ 664.492470] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.492795] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.492922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.493173] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.493278] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.494150] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.494301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.494338] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.494659] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.494659] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.494790] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.494790] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.494944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.497095] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.497095] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.500396] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-75a0cbae-2863-40ba-a7fe-e0407e9c8c5a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.500518] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75a0cbae-2863-40ba-a7fe-e0407e9c8c5a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.500624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75a0cbae-2863-40ba-a7fe-e0407e9c8c5a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.500754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75a0cbae-2863-40ba-a7fe-e0407e9c8c5a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.501024] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75a0cbae-2863-40ba-a7fe-e0407e9c8c5a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.581519] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54038215-926d-4af7-820c-4eb952c9aac0 in Status: SUCCESS [ 664.581756] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.627606] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91c579b7-248b-45d7-a285-fe3d62562362 [ 664.627891] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.627974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.628095] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.628418] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.628479] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.628844] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91c579b7-248b-45d7-a285-fe3d62562362 already deleted. [ 664.628844] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91c579b7-248b-45d7-a285-fe3d62562362" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.792757] env[69559]: INFO networking_nsxv3.common.synchronization [None req-3727d002-1aa0-40b5-8ef1-ed63fa9e7130 tempest-ServersTestJSON-1384568919 tempest-ServersTestJSON-1384568919-project-member] Enqueued Resource ID: 99092389-59da-4e36-9a78-d2e1e7edec3e with Priority: HIGHEST for action security_group_rules [ 664.793360] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99092389-59da-4e36-9a78-d2e1e7edec3e with Priority: HIGHEST for action security_group_rules [ 664.793668] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99092389-59da-4e36-9a78-d2e1e7edec3e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.794227] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.794227] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.795247] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.795247] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99092389-59da-4e36-9a78-d2e1e7edec3e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.877744] env[69559]: INFO networking_nsxv3.common.synchronization [req-46a64bd7-31b1-43c0-be50-8b3e6114ace0 req-3c8551b4-0519-4c8b-84e1-5bd321a31db6 service nova] Enqueued Resource ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 with Priority: HIGHEST for action security_group_rules [ 664.877744] env[69559]: INFO networking_nsxv3.common.synchronization [req-46a64bd7-31b1-43c0-be50-8b3e6114ace0 req-3c8551b4-0519-4c8b-84e1-5bd321a31db6 service nova] Enqueued Resource ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 with Priority: HIGHEST for action security_group_members [ 664.877744] env[69559]: INFO networking_nsxv3.common.synchronization [req-46a64bd7-31b1-43c0-be50-8b3e6114ace0 req-3c8551b4-0519-4c8b-84e1-5bd321a31db6 service nova] Enqueued Resource ID: 28e30bbf-507e-47f2-9636-675860041f7b with Priority: HIGHEST for action port [ 664.877744] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 with Priority: HIGHEST for action security_group_rules [ 664.877744] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 with Priority: HIGHEST for action security_group_members [ 664.877744] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28e30bbf-507e-47f2-9636-675860041f7b with Priority: HIGHEST for action port [ 664.877744] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d3ab8f7-3874-4370-9e84-4a90ecd908d1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.881238] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.881340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.882646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.882646] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d3ab8f7-3874-4370-9e84-4a90ecd908d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.883208] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.883208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.883411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.883578] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.883929] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.886873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.886873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.886873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.886873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.886873] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d3ab8f7-3874-4370-9e84-4a90ecd908d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.886873] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-28e30bbf-507e-47f2-9636-675860041f7b taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.886873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28e30bbf-507e-47f2-9636-675860041f7b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.886873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28e30bbf-507e-47f2-9636-675860041f7b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.886873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28e30bbf-507e-47f2-9636-675860041f7b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.886873] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28e30bbf-507e-47f2-9636-675860041f7b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.002117] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.003088] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.003203] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.003343] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75a0cbae-2863-40ba-a7fe-e0407e9c8c5a with status ACTIVE [ 665.003498] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.003602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.003665] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.003867] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.004027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.004205] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.004304] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.004369] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.004526] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.004605] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.004781] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.004959] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.004959] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.005555] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.005555] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.005555] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75a0cbae-2863-40ba-a7fe-e0407e9c8c5a is going to be updated. [ 665.025471] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.025633] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.025680] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.026249] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.026249] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.026249] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75a0cbae-2863-40ba-a7fe-e0407e9c8c5a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.069026] env[69559]: INFO networking_nsxv3.common.synchronization [None req-bb24e866-840b-4711-8641-2e10749963bc tempest-ServersTestJSON-1384568919 tempest-ServersTestJSON-1384568919-project-member] Enqueued Resource ID: 99092389-59da-4e36-9a78-d2e1e7edec3e with Priority: HIGHEST for action security_group_rules [ 665.069507] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99092389-59da-4e36-9a78-d2e1e7edec3e with Priority: HIGHEST for action security_group_rules [ 665.069819] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99092389-59da-4e36-9a78-d2e1e7edec3e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.069940] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.320844] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.321054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.321165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.321465] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.321598] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.321735] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99092389-59da-4e36-9a78-d2e1e7edec3e already deleted. [ 665.322656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.322656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.322656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.322656] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99092389-59da-4e36-9a78-d2e1e7edec3e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.388615] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d3ab8f7-3874-4370-9e84-4a90ecd908d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.392146] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.392146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.392146] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 28e30bbf-507e-47f2-9636-675860041f7b with status ACTIVE [ 665.392146] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.392146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.392146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.392146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.392146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.392146] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.392146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.392146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.392146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.392146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.392146] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.393376] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.393376] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.394267] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.395922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.395922] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 28e30bbf-507e-47f2-9636-675860041f7b is going to be updated. [ 665.414315] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.414457] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.414605] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.414769] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.414985] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.415129] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28e30bbf-507e-47f2-9636-675860041f7b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.508136] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.668113] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe in Status: SUCCESS [ 665.668365] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.668463] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.668678] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.668868] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.669020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.669067] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.669246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.669330] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.669432] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.669548] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6bb8723-4212-49f6-9e0f-6762cf861cbe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.844131] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.844131] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.844131] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.844288] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.844321] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.844528] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99092389-59da-4e36-9a78-d2e1e7edec3e already deleted. [ 665.844528] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.852846] env[69559]: INFO networking_nsxv3.common.synchronization [None req-e3ad8d01-da72-4e78-a038-022c11117472 None None] Enqueued Resource ID: f0cb616a-a6a2-4538-b1de-28dedfd0e39e with Priority: HIGHEST for action port [ 665.853151] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0cb616a-a6a2-4538-b1de-28dedfd0e39e with Priority: HIGHEST for action port [ 665.854390] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0cb616a-a6a2-4538-b1de-28dedfd0e39e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.854508] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0cb616a-a6a2-4538-b1de-28dedfd0e39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.854578] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0cb616a-a6a2-4538-b1de-28dedfd0e39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.855497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0cb616a-a6a2-4538-b1de-28dedfd0e39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.855497] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0cb616a-a6a2-4538-b1de-28dedfd0e39e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.896725] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d3ab8f7-3874-4370-9e84-4a90ecd908d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.011671] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.011671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.011671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.011671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.011671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.011671] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 is going to be created. [ 666.042259] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.042259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.042259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.042259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.042259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.050935] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: UNINITIALIZED for 2s [ 666.173644] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6bb8723-4212-49f6-9e0f-6762cf861cbe taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.173807] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.173877] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.174172] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.174292] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.174385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.174446] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.174590] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.174670] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.174756] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.174896] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6bb8723-4212-49f6-9e0f-6762cf861cbe taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.174992] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.175099] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.175200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.175333] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.175420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.175476] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.175606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.175961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.176116] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.177052] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6bb8723-4212-49f6-9e0f-6762cf861cbe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.359604] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f0cb616a-a6a2-4538-b1de-28dedfd0e39e [ 666.360860] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.362438] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.362438] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.362438] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.363105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.363929] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f0cb616a-a6a2-4538-b1de-28dedfd0e39e already deleted. [ 666.364054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0cb616a-a6a2-4538-b1de-28dedfd0e39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.401124] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.401459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.401535] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.402299] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.402542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.404527] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 is going to be created. [ 666.429637] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.429977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.430174] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.430478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.430740] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.440383] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 in Status: UNINITIALIZED for 2s [ 666.683679] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6bb8723-4212-49f6-9e0f-6762cf861cbe: rpc.has_security_group_logging(os_id): False [ 666.700160] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.700587] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.701396] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.704073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.704073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.704073] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.704073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.704073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.704073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.704073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.704073] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.704073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.704073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.704073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.704073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.704073] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.704073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.704707] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.704707] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.704707] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.704707] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe is going to be created. [ 666.763072] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.763072] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.763072] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.763072] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.763072] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.778027] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe in Status: IN_PROGRESS for 2s [ 667.480393] env[69559]: INFO networking_nsxv3.common.synchronization [None req-c7fb1669-964f-44b8-a90e-09fd9f6214fc None None] Enqueued Resource ID: 7f65e39e-b7d3-406b-9669-cf24ac3959a9 with Priority: HIGHEST for action port [ 667.480393] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f65e39e-b7d3-406b-9669-cf24ac3959a9 with Priority: HIGHEST for action port [ 667.480393] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f65e39e-b7d3-406b-9669-cf24ac3959a9 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.480393] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f65e39e-b7d3-406b-9669-cf24ac3959a9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.480393] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f65e39e-b7d3-406b-9669-cf24ac3959a9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.480393] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f65e39e-b7d3-406b-9669-cf24ac3959a9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.482186] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f65e39e-b7d3-406b-9669-cf24ac3959a9',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.986574] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f65e39e-b7d3-406b-9669-cf24ac3959a9 [ 667.986574] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.986574] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.986574] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.986574] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.986574] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.986574] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f65e39e-b7d3-406b-9669-cf24ac3959a9 already deleted. [ 667.987233] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f65e39e-b7d3-406b-9669-cf24ac3959a9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.060904] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: SUCCESS [ 668.061072] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.061199] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.061425] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.061620] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.061737] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.061799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.061969] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.062114] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.062165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.062266] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.455070] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 in Status: SUCCESS [ 668.455310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.455476] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.455729] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.456608] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.456608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.456608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.456608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.456608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.456608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.456898] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d3ab8f7-3874-4370-9e84-4a90ecd908d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.539733] env[69559]: INFO networking_nsxv3.common.synchronization [None req-8e4ae064-67ad-480f-ab95-472396f5ec20 None None] Enqueued Resource ID: 234fc86f-2cec-4a60-93f9-7fc205b6e83e with Priority: HIGHEST for action port [ 668.540690] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 234fc86f-2cec-4a60-93f9-7fc205b6e83e with Priority: HIGHEST for action port [ 668.540690] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-234fc86f-2cec-4a60-93f9-7fc205b6e83e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.541128] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-234fc86f-2cec-4a60-93f9-7fc205b6e83e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.541128] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-234fc86f-2cec-4a60-93f9-7fc205b6e83e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.544773] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-234fc86f-2cec-4a60-93f9-7fc205b6e83e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.544773] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('234fc86f-2cec-4a60-93f9-7fc205b6e83e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.567026] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.567026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.567026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.567026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.567026] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.567026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.567026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.567026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.567026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.567026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.567026] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.567026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.567026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.567026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.567026] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.567026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.568704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.568704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.568704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.568704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.568704] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.785688] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe in Status: SUCCESS [ 668.785894] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.962878] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.963061] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.963124] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.963359] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.965362] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.965362] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.965362] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.965550] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.965589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.969017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.969017] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.969017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.969017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.969017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.969017] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.969017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.969017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.969017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.969017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.969017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.969017] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d3ab8f7-3874-4370-9e84-4a90ecd908d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.047369] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 234fc86f-2cec-4a60-93f9-7fc205b6e83e [ 669.048460] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.048460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.048460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.048460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.048460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.048460] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:234fc86f-2cec-4a60-93f9-7fc205b6e83e already deleted. [ 669.048460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-234fc86f-2cec-4a60-93f9-7fc205b6e83e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.071423] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 392028d0-93e9-4420-8ca7-d3fa218b5c83: rpc.has_security_group_logging(os_id): False [ 669.088018] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.088018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.088018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.088018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.088018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.088018] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.088018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.088018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.088018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.088018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.088940] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.091615] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.091615] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.091615] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.091615] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.091615] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.091615] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.091615] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.091615] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.091615] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.091615] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 is going to be created. [ 669.147068] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.147068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.147068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.147068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.149022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.156884] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: IN_PROGRESS for 2s [ 669.470218] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d3ab8f7-3874-4370-9e84-4a90ecd908d1: rpc.has_security_group_logging(os_id): False [ 669.492147] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.492147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.492147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.492147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.492147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.492147] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.492147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.492147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.492147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.492147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.492147] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.492147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.492147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.492147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.492147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.492690] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.492690] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.492690] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.492690] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.492690] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.492690] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 is going to be created. [ 669.558848] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.559052] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.559132] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.559540] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.559953] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.572659] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 in Status: IN_PROGRESS for 2s [ 671.171676] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: SUCCESS [ 671.171676] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.333696] env[69559]: INFO networking_nsxv3.common.synchronization [req-04f2bb1a-e2f8-41aa-888b-0cadf4006407 req-4a31a86e-58aa-48ff-b39b-72d4857f3d7f tempest-ServerDiagnosticsNegativeTest-2008506713 tempest-ServerDiagnosticsNegativeTest-2008506713-project-member] Enqueued Resource ID: 54038215-926d-4af7-820c-4eb952c9aac0 with Priority: HIGHEST for action security_group_members [ 671.334983] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54038215-926d-4af7-820c-4eb952c9aac0 with Priority: HIGHEST for action security_group_members [ 671.334983] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-54038215-926d-4af7-820c-4eb952c9aac0 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.334983] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.335195] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.336041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.336704] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.336811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.336873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.337083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.337188] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.337301] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54038215-926d-4af7-820c-4eb952c9aac0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.347292] env[69559]: INFO networking_nsxv3.common.synchronization [req-0221fd02-de3d-4d10-924f-6038209a6ec9 req-66645987-3978-4ef9-95e9-f691b7cbf1ce tempest-ServerDiagnosticsTest-166480050 tempest-ServerDiagnosticsTest-166480050-project-member] Enqueued Resource ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa with Priority: HIGHEST for action security_group_members [ 671.347292] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa with Priority: HIGHEST for action security_group_members [ 671.347292] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-825fa80b-a9de-4b97-ae04-49c19c2e9faa taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.347292] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.347292] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.347928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.347928] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.347928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.347928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.348296] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.348410] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.348529] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('825fa80b-a9de-4b97-ae04-49c19c2e9faa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.586468] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 in Status: SUCCESS [ 671.587809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.841174] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.841348] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.841423] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.841666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.841733] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.841929] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.842045] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.842093] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.842292] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.842372] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.842421] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54038215-926d-4af7-820c-4eb952c9aac0 is going to be updated. [ 671.850526] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.850721] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.851067] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.851320] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.851463] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.851736] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.851893] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.851999] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.852180] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.852259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.852558] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa already deleted. [ 671.852558] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.869716] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.869716] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.869716] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.871115] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.871115] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.877924] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54038215-926d-4af7-820c-4eb952c9aac0 in Status: IN_PROGRESS for 2s [ 672.235772] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.237380] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.237380] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.237380] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.237380] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.237380] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.237380] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.237380] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.237380] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.238222] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 672.238222] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 672.238222] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 672.238222] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 672.238222] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 672.238222] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 672.238603] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 672.265391] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 672.265569] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 672.265712] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 672.265890] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.266268] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-6f0808f9-0e98-4788-85b0-923ee0e52474 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.266454] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-6f0808f9-0e98-4788-85b0-923ee0e52474" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.266579] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-6f0808f9-0e98-4788-85b0-923ee0e52474" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.266914] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-6f0808f9-0e98-4788-85b0-923ee0e52474" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.267105] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f0808f9-0e98-4788-85b0-923ee0e52474',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.773024] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.773024] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.773024] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.773186] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.773311] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.773471] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 6f0808f9-0e98-4788-85b0-923ee0e52474 not found, creating... [ 672.773765] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.773929] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.774060] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.774298] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.774436] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.774799] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.774999] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.776224] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.776536] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.776750] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.776955] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 6f0808f9-0e98-4788-85b0-923ee0e52474 is going to be created. [ 672.797583] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.798043] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.798198] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.798486] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.798737] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.798966] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-6f0808f9-0e98-4788-85b0-923ee0e52474" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.889956] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54038215-926d-4af7-820c-4eb952c9aac0 in Status: SUCCESS [ 673.889956] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54038215-926d-4af7-820c-4eb952c9aac0 deletion is rescheduled due to dependency. [ 673.889956] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54038215-926d-4af7-820c-4eb952c9aac0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.085357] env[69559]: INFO networking_nsxv3.common.synchronization [req-e6fc0fad-92b6-46e8-9b41-ed5cd8904fe2 req-831e0297-c05a-4b7b-aa96-74a7c7a0f8b9 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 with Priority: HIGHEST for action security_group_members [ 674.085357] env[69559]: INFO networking_nsxv3.common.synchronization [req-e6fc0fad-92b6-46e8-9b41-ed5cd8904fe2 req-831e0297-c05a-4b7b-aa96-74a7c7a0f8b9 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 674.085357] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 with Priority: HIGHEST for action security_group_members [ 674.085357] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 674.085357] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-73e98fb7-5118-4cdb-830b-497719ecfad4 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.085357] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.086250] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.086739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.087375] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.087678] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.088581] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.089142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.089405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.089637] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.091137] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.091407] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.091601] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.092143] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.092437] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.094099] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.094099] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.094099] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.094099] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.094099] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.279705] env[69559]: INFO networking_nsxv3.common.synchronization [req-e6fc0fad-92b6-46e8-9b41-ed5cd8904fe2 req-831e0297-c05a-4b7b-aa96-74a7c7a0f8b9 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_rules [ 674.279705] env[69559]: INFO networking_nsxv3.common.synchronization [req-e6fc0fad-92b6-46e8-9b41-ed5cd8904fe2 req-831e0297-c05a-4b7b-aa96-74a7c7a0f8b9 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 674.279860] env[69559]: INFO networking_nsxv3.common.synchronization [req-e6fc0fad-92b6-46e8-9b41-ed5cd8904fe2 req-831e0297-c05a-4b7b-aa96-74a7c7a0f8b9 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 with Priority: HIGHEST for action security_group_rules [ 674.279896] env[69559]: INFO networking_nsxv3.common.synchronization [req-e6fc0fad-92b6-46e8-9b41-ed5cd8904fe2 req-831e0297-c05a-4b7b-aa96-74a7c7a0f8b9 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 with Priority: HIGHEST for action security_group_members [ 674.280045] env[69559]: INFO networking_nsxv3.common.synchronization [req-e6fc0fad-92b6-46e8-9b41-ed5cd8904fe2 req-831e0297-c05a-4b7b-aa96-74a7c7a0f8b9 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 75a0cbae-2863-40ba-a7fe-e0407e9c8c5a with Priority: HIGHEST for action port [ 674.280581] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_rules [ 674.280726] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 with Priority: HIGHEST for action security_group_rules [ 674.281516] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75a0cbae-2863-40ba-a7fe-e0407e9c8c5a with Priority: HIGHEST for action port [ 674.282034] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 674.283218] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 with Priority: HIGHEST for action security_group_members [ 674.287177] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.287280] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.287356] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.287566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.287650] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.289074] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73e98fb7-5118-4cdb-830b-497719ecfad4 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.289237] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.289330] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.289589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.289699] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.290491] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-75a0cbae-2863-40ba-a7fe-e0407e9c8c5a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.290642] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75a0cbae-2863-40ba-a7fe-e0407e9c8c5a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.290734] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75a0cbae-2863-40ba-a7fe-e0407e9c8c5a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.291523] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75a0cbae-2863-40ba-a7fe-e0407e9c8c5a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.291726] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75a0cbae-2863-40ba-a7fe-e0407e9c8c5a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.292674] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.292805] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.293050] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-73e98fb7-5118-4cdb-830b-497719ecfad4 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.293277] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.316299] env[69559]: INFO networking_nsxv3.common.synchronization [req-0221fd02-de3d-4d10-924f-6038209a6ec9 req-27bfaab6-a383-4836-93ea-43b0999a7e63 service nova] Enqueued Resource ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa with Priority: HIGHEST for action security_group_rules [ 674.316299] env[69559]: INFO networking_nsxv3.common.synchronization [req-0221fd02-de3d-4d10-924f-6038209a6ec9 req-27bfaab6-a383-4836-93ea-43b0999a7e63 service nova] Enqueued Resource ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa with Priority: HIGHEST for action security_group_members [ 674.316299] env[69559]: INFO networking_nsxv3.common.synchronization [req-0221fd02-de3d-4d10-924f-6038209a6ec9 req-27bfaab6-a383-4836-93ea-43b0999a7e63 service nova] Enqueued Resource ID: 6f0808f9-0e98-4788-85b0-923ee0e52474 with Priority: HIGHEST for action port [ 674.316299] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa with Priority: HIGHEST for action security_group_rules [ 674.316299] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa with Priority: HIGHEST for action security_group_members [ 674.316299] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f0808f9-0e98-4788-85b0-923ee0e52474 with Priority: HIGHEST for action port [ 674.316299] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-825fa80b-a9de-4b97-ae04-49c19c2e9faa taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.316299] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.316299] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.316299] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.316299] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('825fa80b-a9de-4b97-ae04-49c19c2e9faa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.316786] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-825fa80b-a9de-4b97-ae04-49c19c2e9faa taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.316890] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.316999] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.317518] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.317738] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.317897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.317962] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.318225] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.318389] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.318432] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('825fa80b-a9de-4b97-ae04-49c19c2e9faa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.319602] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f0808f9-0e98-4788-85b0-923ee0e52474 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.319743] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f0808f9-0e98-4788-85b0-923ee0e52474" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.319779] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f0808f9-0e98-4788-85b0-923ee0e52474" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.319945] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f0808f9-0e98-4788-85b0-923ee0e52474" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.320034] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f0808f9-0e98-4788-85b0-923ee0e52474',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.420271] env[69559]: INFO networking_nsxv3.common.synchronization [req-80fd187f-37ae-4014-aa77-694670518b38 req-6fa0e3b3-eb7c-47ea-9fc0-8ed6a299490e tempest-FloatingIPsAssociationTestJSON-1860057914 tempest-FloatingIPsAssociationTestJSON-1860057914-project-member] Enqueued Resource ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 with Priority: HIGHEST for action security_group_members [ 674.421029] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 with Priority: HIGHEST for action security_group_members [ 674.421545] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f7f9d2e-64a3-4672-969a-45f64c5621d1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.421681] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.421739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.422183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.422527] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.422527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.422755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.422755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.422878] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.422975] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f7f9d2e-64a3-4672-969a-45f64c5621d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.588314] env[69559]: INFO networking_nsxv3.common.synchronization [None req-198d5545-2a0d-4a18-9d8f-bce61bd775e5 None None] Enqueued Resource ID: 44534961-0600-4f3f-a015-54da50561f09 with Priority: HIGHEST for action port [ 674.588712] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44534961-0600-4f3f-a015-54da50561f09 with Priority: HIGHEST for action port [ 674.591853] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-44534961-0600-4f3f-a015-54da50561f09 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.591853] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44534961-0600-4f3f-a015-54da50561f09" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.591853] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44534961-0600-4f3f-a015-54da50561f09" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.595372] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44534961-0600-4f3f-a015-54da50561f09" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.595372] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44534961-0600-4f3f-a015-54da50561f09',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.596974] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.599061] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.797074] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.797074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.797074] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-73e98fb7-5118-4cdb-830b-497719ecfad4 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.797074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.797074] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75a0cbae-2863-40ba-a7fe-e0407e9c8c5a with status ACTIVE [ 674.797074] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.797074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.797074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.797074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.797074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.797074] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.797074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.797074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.797074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.797074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.797758] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.797758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.797758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.797758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.797758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.801064] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75a0cbae-2863-40ba-a7fe-e0407e9c8c5a is going to be updated. [ 674.821597] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.822219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.822486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.822915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.823241] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.823873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75a0cbae-2863-40ba-a7fe-e0407e9c8c5a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.824244] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('825fa80b-a9de-4b97-ae04-49c19c2e9faa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.825958] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-825fa80b-a9de-4b97-ae04-49c19c2e9faa taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.829077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.829077] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6f0808f9-0e98-4788-85b0-923ee0e52474 with status ACTIVE [ 674.829077] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.829077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.829077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.829077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.829077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.829077] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.829077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.829077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.829077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.829077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.829077] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.829077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.829077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.829077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.829077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.829763] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6f0808f9-0e98-4788-85b0-923ee0e52474 is going to be updated. [ 674.853127] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.853773] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.854029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.854367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.854632] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.854896] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f0808f9-0e98-4788-85b0-923ee0e52474" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.874374] env[69559]: INFO networking_nsxv3.common.synchronization [None req-d2c05e65-f692-4cf0-aaf4-d18563289652 None None] Enqueued Resource ID: a67c4625-baef-412a-a1cd-2dd317168aec with Priority: HIGHEST for action port [ 674.874374] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a67c4625-baef-412a-a1cd-2dd317168aec with Priority: HIGHEST for action port [ 674.874374] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-a67c4625-baef-412a-a1cd-2dd317168aec taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.874374] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a67c4625-baef-412a-a1cd-2dd317168aec" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.874374] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a67c4625-baef-412a-a1cd-2dd317168aec" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.874374] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a67c4625-baef-412a-a1cd-2dd317168aec" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.874374] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a67c4625-baef-412a-a1cd-2dd317168aec',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.926394] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.926394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.926394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.926394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.926394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.926394] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.926394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.926394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.926394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.926394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.927105] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 already deleted. [ 674.927105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.099618] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44534961-0600-4f3f-a015-54da50561f09 [ 675.099857] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.099988] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.100071] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.100366] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.100466] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.100563] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44534961-0600-4f3f-a015-54da50561f09 already deleted. [ 675.100647] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44534961-0600-4f3f-a015-54da50561f09" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.100868] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.102243] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.333053] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('825fa80b-a9de-4b97-ae04-49c19c2e9faa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.362628] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.362628] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-985" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.362749] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-985" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.365748] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-985" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.365748] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.365748] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.365748] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.365748] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.365748] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.365748] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 675.365748] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.365748] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.365748] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.365748] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 675.365748] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.365748] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.385398] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.385398] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 675.385398] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.385398] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-985" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.385398] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-7dce24e1-21b5-4d84-b3eb-d86ac7640192 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.385398] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-7dce24e1-21b5-4d84-b3eb-d86ac7640192" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.385398] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-7dce24e1-21b5-4d84-b3eb-d86ac7640192" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.385398] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-7dce24e1-21b5-4d84-b3eb-d86ac7640192" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.385398] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7dce24e1-21b5-4d84-b3eb-d86ac7640192',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.386869] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a67c4625-baef-412a-a1cd-2dd317168aec [ 675.386869] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.386869] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.386869] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.386869] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.386869] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.388219] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a67c4625-baef-412a-a1cd-2dd317168aec already deleted. [ 675.388219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a67c4625-baef-412a-a1cd-2dd317168aec" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.605237] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.605412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.605484] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.605697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.605784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.605876] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 is going to be created. [ 675.607432] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.607432] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.607432] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.607626] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.607660] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.607736] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 is going to be updated. [ 675.631901] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.631901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.631901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.631901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.632826] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.636345] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.636345] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.636472] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.640035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.640035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.646088] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 in Status: UNINITIALIZED for 2s [ 675.646715] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: IN_PROGRESS for 2s [ 675.835849] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.836488] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.836641] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.836922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.837512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.837512] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa is going to be created. [ 675.860363] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.860363] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.860363] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.860573] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.860607] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.869751] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa in Status: UNINITIALIZED for 2s [ 675.891904] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.892257] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.892818] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.893520] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.894393] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.894393] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 7dce24e1-21b5-4d84-b3eb-d86ac7640192 not found, creating... [ 675.894393] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.894393] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.894652] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.894705] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.894852] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.895892] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.896150] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.896327] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.896604] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.897224] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.897450] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 7dce24e1-21b5-4d84-b3eb-d86ac7640192 is going to be created. [ 675.923306] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.923306] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.923306] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.923306] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.923306] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.923306] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-7dce24e1-21b5-4d84-b3eb-d86ac7640192" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.021984] env[69559]: INFO networking_nsxv3.common.synchronization [None req-af22c914-1727-448c-a239-fa59721e287d None None] Enqueued Resource ID: 9f532e6f-08db-4985-8ba4-f1094b393ae2 with Priority: HIGHEST for action port [ 676.022669] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f532e6f-08db-4985-8ba4-f1094b393ae2 with Priority: HIGHEST for action port [ 676.022888] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f532e6f-08db-4985-8ba4-f1094b393ae2 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.023032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f532e6f-08db-4985-8ba4-f1094b393ae2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.023032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f532e6f-08db-4985-8ba4-f1094b393ae2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.025768] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f532e6f-08db-4985-8ba4-f1094b393ae2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.025768] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f532e6f-08db-4985-8ba4-f1094b393ae2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.424097] env[69559]: INFO networking_nsxv3.common.synchronization [req-d53f0f22-1e9e-4f25-af93-a3fe43fa3c15 req-9e0f3080-45ba-4236-89ff-3e51f008ca61 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 with Priority: HIGHEST for action security_group_members [ 676.424097] env[69559]: INFO networking_nsxv3.common.synchronization [req-d53f0f22-1e9e-4f25-af93-a3fe43fa3c15 req-9e0f3080-45ba-4236-89ff-3e51f008ca61 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 676.424097] env[69559]: INFO networking_nsxv3.common.synchronization [req-d53f0f22-1e9e-4f25-af93-a3fe43fa3c15 req-9e0f3080-45ba-4236-89ff-3e51f008ca61 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 with Priority: HIGHEST for action security_group_members [ 676.424097] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 with Priority: HIGHEST for action security_group_members [ 676.424246] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 676.424291] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 with Priority: HIGHEST for action security_group_members [ 676.426190] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-73e98fb7-5118-4cdb-830b-497719ecfad4 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.426190] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.426190] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.426338] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.427204] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-162b0750-9392-4d6d-b97a-5ce01d5e0894 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.427204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.427204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.427204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.428153] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.428153] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.428153] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.428153] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.428153] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.428153] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('162b0750-9392-4d6d-b97a-5ce01d5e0894',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.530370] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f532e6f-08db-4985-8ba4-f1094b393ae2 [ 676.530370] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.530370] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.530370] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.530370] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.530370] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.530370] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f532e6f-08db-4985-8ba4-f1094b393ae2 already deleted. [ 676.530370] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f532e6f-08db-4985-8ba4-f1094b393ae2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.670918] env[69559]: INFO networking_nsxv3.common.synchronization [req-d53f0f22-1e9e-4f25-af93-a3fe43fa3c15 req-9e0f3080-45ba-4236-89ff-3e51f008ca61 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 with Priority: HIGHEST for action security_group_rules [ 676.671218] env[69559]: INFO networking_nsxv3.common.synchronization [req-d53f0f22-1e9e-4f25-af93-a3fe43fa3c15 req-9e0f3080-45ba-4236-89ff-3e51f008ca61 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 with Priority: HIGHEST for action security_group_members [ 676.671330] env[69559]: INFO networking_nsxv3.common.synchronization [req-d53f0f22-1e9e-4f25-af93-a3fe43fa3c15 req-9e0f3080-45ba-4236-89ff-3e51f008ca61 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_rules [ 676.671580] env[69559]: INFO networking_nsxv3.common.synchronization [req-d53f0f22-1e9e-4f25-af93-a3fe43fa3c15 req-9e0f3080-45ba-4236-89ff-3e51f008ca61 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 676.671656] env[69559]: INFO networking_nsxv3.common.synchronization [req-d53f0f22-1e9e-4f25-af93-a3fe43fa3c15 req-9e0f3080-45ba-4236-89ff-3e51f008ca61 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 with Priority: HIGHEST for action security_group_rules [ 676.672025] env[69559]: INFO networking_nsxv3.common.synchronization [req-d53f0f22-1e9e-4f25-af93-a3fe43fa3c15 req-9e0f3080-45ba-4236-89ff-3e51f008ca61 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 with Priority: HIGHEST for action security_group_members [ 676.672213] env[69559]: INFO networking_nsxv3.common.synchronization [req-d53f0f22-1e9e-4f25-af93-a3fe43fa3c15 req-9e0f3080-45ba-4236-89ff-3e51f008ca61 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 75a0cbae-2863-40ba-a7fe-e0407e9c8c5a with Priority: HIGHEST for action port [ 676.672692] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 with Priority: HIGHEST for action security_group_rules [ 676.672845] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_rules [ 676.672954] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 with Priority: HIGHEST for action security_group_members [ 676.673176] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75a0cbae-2863-40ba-a7fe-e0407e9c8c5a with Priority: HIGHEST for action port [ 676.673176] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 with Priority: HIGHEST for action security_group_rules [ 676.673281] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 with Priority: HIGHEST for action security_group_members [ 676.673329] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 676.674340] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-162b0750-9392-4d6d-b97a-5ce01d5e0894 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.674340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.674340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.674340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.674340] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('162b0750-9392-4d6d-b97a-5ce01d5e0894',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.675298] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.675408] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.675645] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-73e98fb7-5118-4cdb-830b-497719ecfad4 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.675731] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.675907] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-75a0cbae-2863-40ba-a7fe-e0407e9c8c5a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.676014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75a0cbae-2863-40ba-a7fe-e0407e9c8c5a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.676082] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75a0cbae-2863-40ba-a7fe-e0407e9c8c5a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.676258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75a0cbae-2863-40ba-a7fe-e0407e9c8c5a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.676329] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75a0cbae-2863-40ba-a7fe-e0407e9c8c5a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.677099] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73e98fb7-5118-4cdb-830b-497719ecfad4 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.677194] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.677375] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-162b0750-9392-4d6d-b97a-5ce01d5e0894 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.677462] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.677622] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.677702] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.806080] env[69559]: INFO networking_nsxv3.common.synchronization [req-80fd187f-37ae-4014-aa77-694670518b38 req-4d1b5bfa-f206-47dc-b877-19a9ad1f2dc3 service nova] Enqueued Resource ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 with Priority: HIGHEST for action security_group_rules [ 676.806833] env[69559]: INFO networking_nsxv3.common.synchronization [req-80fd187f-37ae-4014-aa77-694670518b38 req-4d1b5bfa-f206-47dc-b877-19a9ad1f2dc3 service nova] Enqueued Resource ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 with Priority: HIGHEST for action security_group_members [ 676.806833] env[69559]: INFO networking_nsxv3.common.synchronization [req-80fd187f-37ae-4014-aa77-694670518b38 req-4d1b5bfa-f206-47dc-b877-19a9ad1f2dc3 service nova] Enqueued Resource ID: 7dce24e1-21b5-4d84-b3eb-d86ac7640192 with Priority: HIGHEST for action port [ 676.806833] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 with Priority: HIGHEST for action security_group_rules [ 676.806833] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 with Priority: HIGHEST for action security_group_members [ 676.807098] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dce24e1-21b5-4d84-b3eb-d86ac7640192 with Priority: HIGHEST for action port [ 676.807503] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f7f9d2e-64a3-4672-969a-45f64c5621d1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.807631] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.807700] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.807992] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.813658] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f7f9d2e-64a3-4672-969a-45f64c5621d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.813658] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f7f9d2e-64a3-4672-969a-45f64c5621d1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.813658] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.813658] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.813658] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.813658] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.813658] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.813658] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.813658] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.813658] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.813658] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f7f9d2e-64a3-4672-969a-45f64c5621d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.813658] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-7dce24e1-21b5-4d84-b3eb-d86ac7640192 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.813658] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7dce24e1-21b5-4d84-b3eb-d86ac7640192" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.813658] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7dce24e1-21b5-4d84-b3eb-d86ac7640192" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.814960] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7dce24e1-21b5-4d84-b3eb-d86ac7640192" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.815198] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7dce24e1-21b5-4d84-b3eb-d86ac7640192',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.869577] env[69559]: INFO networking_nsxv3.common.synchronization [None req-c22779e8-47de-4efc-86ae-18760cd9f88f None None] Enqueued Resource ID: 972f3172-c5bd-4806-a188-a72e869a359c with Priority: HIGHEST for action port [ 676.869577] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 972f3172-c5bd-4806-a188-a72e869a359c with Priority: HIGHEST for action port [ 676.869577] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-972f3172-c5bd-4806-a188-a72e869a359c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.869577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-972f3172-c5bd-4806-a188-a72e869a359c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.869577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-972f3172-c5bd-4806-a188-a72e869a359c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.870133] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-972f3172-c5bd-4806-a188-a72e869a359c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.870133] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('972f3172-c5bd-4806-a188-a72e869a359c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.931641] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('162b0750-9392-4d6d-b97a-5ce01d5e0894',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.181174] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75a0cbae-2863-40ba-a7fe-e0407e9c8c5a with status ACTIVE [ 677.181174] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.181174] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.181174] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.181174] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.181174] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.181174] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.181616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.181616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.181616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.181616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.183853] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.183853] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.183853] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.183853] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.183853] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.183853] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75a0cbae-2863-40ba-a7fe-e0407e9c8c5a is going to be updated. [ 677.187081] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-162b0750-9392-4d6d-b97a-5ce01d5e0894 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.187081] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.205083] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.205083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.205083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.205083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.205083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.205083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75a0cbae-2863-40ba-a7fe-e0407e9c8c5a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.236447] env[69559]: INFO networking_nsxv3.common.synchronization [req-db4017db-d05c-43ce-b1e8-4bc90f8a3ab5 req-18f3573f-ac4f-4cce-989f-7d2340f6decd tempest-ListImageFiltersTestJSON-342177122 tempest-ListImageFiltersTestJSON-342177122-project-member] Enqueued Resource ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 with Priority: HIGHEST for action security_group_members [ 677.236447] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 with Priority: HIGHEST for action security_group_members [ 677.236447] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.236447] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.236447] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.237102] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.237102] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.237102] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.237282] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.237358] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.237489] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.237614] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d3ab8f7-3874-4370-9e84-4a90ecd908d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.318406] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f7f9d2e-64a3-4672-969a-45f64c5621d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.319397] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f7f9d2e-64a3-4672-969a-45f64c5621d1 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.323678] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.323678] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7dce24e1-21b5-4d84-b3eb-d86ac7640192 with status ACTIVE [ 677.324270] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.324270] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.324270] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.324270] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.324839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.324839] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.324839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.324839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.324839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.324839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.325248] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.325452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.325452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.325550] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.325606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.325718] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7dce24e1-21b5-4d84-b3eb-d86ac7640192 is going to be updated. [ 677.355445] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.355445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.355445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.355445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.355445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.355445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7dce24e1-21b5-4d84-b3eb-d86ac7640192" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.372312] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 972f3172-c5bd-4806-a188-a72e869a359c [ 677.373776] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.373776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.373776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.375164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.375343] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.375505] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:972f3172-c5bd-4806-a188-a72e869a359c already deleted. [ 677.375644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-972f3172-c5bd-4806-a188-a72e869a359c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.434937] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('162b0750-9392-4d6d-b97a-5ce01d5e0894',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.661681] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 in Status: SUCCESS [ 677.661681] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.661681] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.661681] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.661681] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.661681] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.662104] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.662104] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.662104] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.662104] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.665973] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: SUCCESS [ 677.665973] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.665973] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.665973] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.665973] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.665973] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.665973] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.666372] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.666414] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.666541] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.740277] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d3ab8f7-3874-4370-9e84-4a90ecd908d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.761794] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.762024] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.762367] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.762662] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.762943] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.763116] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.763232] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.763444] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.763583] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.763786] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 677.763894] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 677.764088] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 677.764136] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 677.764218] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 677.764319] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 677.764684] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 677.783912] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 677.783912] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 677.783995] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 677.784196] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.784658] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-7ede2ab9-e8b6-4785-8c47-e41e7f44e5d8 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.784854] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-7ede2ab9-e8b6-4785-8c47-e41e7f44e5d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.784972] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-7ede2ab9-e8b6-4785-8c47-e41e7f44e5d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.785340] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-7ede2ab9-e8b6-4785-8c47-e41e7f44e5d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.785476] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ede2ab9-e8b6-4785-8c47-e41e7f44e5d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.824441] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f7f9d2e-64a3-4672-969a-45f64c5621d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.878734] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa in Status: SUCCESS [ 677.879126] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.879214] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.879385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.879600] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.879739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.879808] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.879983] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.880088] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.880180] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.880291] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('825fa80b-a9de-4b97-ae04-49c19c2e9faa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.918659] env[69559]: INFO networking_nsxv3.common.synchronization [None req-abeab9d1-4c6d-4c27-b2db-a25c8efb1a7d None None] Enqueued Resource ID: f88b8570-452e-4ed8-b089-9e773524db19 with Priority: HIGHEST for action port [ 677.918896] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f88b8570-452e-4ed8-b089-9e773524db19 with Priority: HIGHEST for action port [ 677.919957] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-f88b8570-452e-4ed8-b089-9e773524db19 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.919957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f88b8570-452e-4ed8-b089-9e773524db19" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.919957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f88b8570-452e-4ed8-b089-9e773524db19" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.919957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f88b8570-452e-4ed8-b089-9e773524db19" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.919957] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f88b8570-452e-4ed8-b089-9e773524db19',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.938754] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.938966] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.939049] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.939465] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.939465] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.939465] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 is going to be created. [ 677.997480] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.997480] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.997480] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.997480] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.997480] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.018787] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 in Status: UNINITIALIZED for 2s [ 678.166326] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.174449] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.243443] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d3ab8f7-3874-4370-9e84-4a90ecd908d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.291872] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.291872] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.291872] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.291872] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.291872] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.291872] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 7ede2ab9-e8b6-4785-8c47-e41e7f44e5d8 not found, creating... [ 678.291872] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.291872] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.291872] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.291872] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.291872] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.295425] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.295603] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.295735] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.295967] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.296120] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.296265] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 7ede2ab9-e8b6-4785-8c47-e41e7f44e5d8 is going to be created. [ 678.318527] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.318855] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.319045] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.319341] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.319571] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.319797] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-7ede2ab9-e8b6-4785-8c47-e41e7f44e5d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.327578] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.327700] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.327766] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.327957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.328059] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.328149] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 is going to be created. [ 678.330092] env[69559]: INFO networking_nsxv3.common.synchronization [None req-4805303d-bf12-4ee3-bc67-9977c84e54d1 None None] Enqueued Resource ID: 39e12dc4-8e3c-4005-a030-b813d86f83bd with Priority: HIGHEST for action port [ 678.330513] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39e12dc4-8e3c-4005-a030-b813d86f83bd with Priority: HIGHEST for action port [ 678.331431] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-39e12dc4-8e3c-4005-a030-b813d86f83bd taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.331542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39e12dc4-8e3c-4005-a030-b813d86f83bd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.331603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39e12dc4-8e3c-4005-a030-b813d86f83bd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.331835] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39e12dc4-8e3c-4005-a030-b813d86f83bd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.332968] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39e12dc4-8e3c-4005-a030-b813d86f83bd',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.351567] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.351756] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.351756] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.351950] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.352124] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.362705] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 in Status: UNINITIALIZED for 2s [ 678.382957] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-825fa80b-a9de-4b97-ae04-49c19c2e9faa taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.383142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.383226] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.383385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.383536] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.383644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.383701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.383918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.383918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.384073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.384149] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-825fa80b-a9de-4b97-ae04-49c19c2e9faa taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.385825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.385825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.385825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.385825] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.385825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.385825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.385825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.385825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.385825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.386222] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('825fa80b-a9de-4b97-ae04-49c19c2e9faa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.423499] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f88b8570-452e-4ed8-b089-9e773524db19 [ 678.423958] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.426207] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.426207] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.426207] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.426207] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.426207] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f88b8570-452e-4ed8-b089-9e773524db19 already deleted. [ 678.426207] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f88b8570-452e-4ed8-b089-9e773524db19" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.469025] env[69559]: INFO networking_nsxv3.common.synchronization [None req-e000c030-cdcb-4d20-9bca-abdb7e7defb0 None None] Enqueued Resource ID: 042116e2-6685-4166-8c5b-9d05c040fa7f with Priority: HIGHEST for action port [ 678.469222] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 042116e2-6685-4166-8c5b-9d05c040fa7f with Priority: HIGHEST for action port [ 678.469559] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-042116e2-6685-4166-8c5b-9d05c040fa7f taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.469758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-042116e2-6685-4166-8c5b-9d05c040fa7f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.469758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-042116e2-6685-4166-8c5b-9d05c040fa7f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.469995] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-042116e2-6685-4166-8c5b-9d05c040fa7f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.470101] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('042116e2-6685-4166-8c5b-9d05c040fa7f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.669501] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.680370] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.749114] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.749114] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.749114] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.749114] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.749114] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.749114] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 is going to be updated. [ 678.780192] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.780282] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.780320] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.781591] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.781591] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.790176] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 in Status: IN_PROGRESS for 2s [ 678.836628] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39e12dc4-8e3c-4005-a030-b813d86f83bd [ 678.840017] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.840017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.840017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.840017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.840017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.840017] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39e12dc4-8e3c-4005-a030-b813d86f83bd already deleted. [ 678.840017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39e12dc4-8e3c-4005-a030-b813d86f83bd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.890513] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 825fa80b-a9de-4b97-ae04-49c19c2e9faa: rpc.has_security_group_logging(os_id): False [ 678.908539] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.909397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.909529] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.911708] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.912048] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.912727] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.912861] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.912922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.913151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.914684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.914684] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.914684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.914684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.914684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.914684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.914684] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.914684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.914684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.914684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.914684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.914684] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa is going to be created. [ 678.972880] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.972880] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.972880] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.972880] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.972880] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.976344] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 042116e2-6685-4166-8c5b-9d05c040fa7f [ 678.976344] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.976344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.976344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.976344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.976344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.976344] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:042116e2-6685-4166-8c5b-9d05c040fa7f already deleted. [ 678.976344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-042116e2-6685-4166-8c5b-9d05c040fa7f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.981462] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa in Status: IN_PROGRESS for 2s [ 679.173603] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.173603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.173603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.173603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.173603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.173603] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 is going to be updated. [ 679.178191] env[69559]: INFO networking_nsxv3.common.synchronization [None req-8429f203-680e-45ea-b517-05719c8aa837 tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 with Priority: HIGHEST for action security_group_rules [ 679.178866] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 with Priority: HIGHEST for action security_group_rules [ 679.179725] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-858bd0a1-9ee5-49c8-ac77-f218758ad913 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.179906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.179949] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.180196] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.180286] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('858bd0a1-9ee5-49c8-ac77-f218758ad913',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.185059] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.185059] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.185059] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.185059] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.185059] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.185059] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 is going to be updated. [ 679.239229] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.239379] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.239463] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.243016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.243016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.243016] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.243016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.243016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.243016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.243016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.256751] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: IN_PROGRESS for 2s [ 679.259537] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 in Status: IN_PROGRESS for 2s [ 679.280175] env[69559]: INFO networking_nsxv3.common.synchronization [None req-d7de59d8-f784-4423-b562-b2b4c8030465 tempest-AttachInterfacesUnderV243Test-114660582 tempest-AttachInterfacesUnderV243Test-114660582-project-member] Enqueued Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_rules [ 679.280801] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_rules [ 679.281829] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1068186a-ec83-4273-b088-3f5610ae229e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.281829] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.281829] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.282249] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.282366] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.350416] env[69559]: INFO networking_nsxv3.common.synchronization [None req-8cab3d25-40a4-44a6-9512-10833e7d7317 None None] Enqueued Resource ID: 9c295bc4-49b4-44af-8882-6ff6a0658bf2 with Priority: HIGHEST for action port [ 679.350416] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c295bc4-49b4-44af-8882-6ff6a0658bf2 with Priority: HIGHEST for action port [ 679.350416] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c295bc4-49b4-44af-8882-6ff6a0658bf2 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.350416] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c295bc4-49b4-44af-8882-6ff6a0658bf2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.350416] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c295bc4-49b4-44af-8882-6ff6a0658bf2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.350416] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c295bc4-49b4-44af-8882-6ff6a0658bf2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.350416] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c295bc4-49b4-44af-8882-6ff6a0658bf2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.473406] env[69559]: INFO networking_nsxv3.common.synchronization [None req-7db1c3be-3c82-42d1-a87c-b8460ed8fb2e tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 with Priority: HIGHEST for action security_group_rules [ 679.473406] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 with Priority: HIGHEST for action security_group_rules [ 679.473406] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-858bd0a1-9ee5-49c8-ac77-f218758ad913 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.473406] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.564168] env[69559]: INFO networking_nsxv3.common.synchronization [req-db4017db-d05c-43ce-b1e8-4bc90f8a3ab5 req-b6733b83-0fd8-4b54-9afd-fbe3d9a292f7 service nova] Enqueued Resource ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 with Priority: HIGHEST for action security_group_rules [ 679.564424] env[69559]: INFO networking_nsxv3.common.synchronization [req-db4017db-d05c-43ce-b1e8-4bc90f8a3ab5 req-b6733b83-0fd8-4b54-9afd-fbe3d9a292f7 service nova] Enqueued Resource ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 with Priority: HIGHEST for action security_group_members [ 679.564537] env[69559]: INFO networking_nsxv3.common.synchronization [req-db4017db-d05c-43ce-b1e8-4bc90f8a3ab5 req-b6733b83-0fd8-4b54-9afd-fbe3d9a292f7 service nova] Enqueued Resource ID: 7ede2ab9-e8b6-4785-8c47-e41e7f44e5d8 with Priority: HIGHEST for action port [ 679.567334] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 with Priority: HIGHEST for action security_group_rules [ 679.567611] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 with Priority: HIGHEST for action security_group_members [ 679.567702] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ede2ab9-e8b6-4785-8c47-e41e7f44e5d8 with Priority: HIGHEST for action port [ 679.568347] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d3ab8f7-3874-4370-9e84-4a90ecd908d1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.568469] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.568624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.568764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.569093] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d3ab8f7-3874-4370-9e84-4a90ecd908d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.569830] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.569920] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.570200] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ede2ab9-e8b6-4785-8c47-e41e7f44e5d8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.570267] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ede2ab9-e8b6-4785-8c47-e41e7f44e5d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.570323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ede2ab9-e8b6-4785-8c47-e41e7f44e5d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.571044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ede2ab9-e8b6-4785-8c47-e41e7f44e5d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.571044] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ede2ab9-e8b6-4785-8c47-e41e7f44e5d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.588226] env[69559]: INFO networking_nsxv3.common.synchronization [None req-f519c680-edbf-42e5-8021-8704a052e62e tempest-AttachInterfacesUnderV243Test-114660582 tempest-AttachInterfacesUnderV243Test-114660582-project-member] Enqueued Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_rules [ 679.588790] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_rules [ 679.591208] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1068186a-ec83-4273-b088-3f5610ae229e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.591357] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.698446] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.698641] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.698702] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.698904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.699015] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.699113] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 already deleted. [ 679.699201] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.699761] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.699961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.700054] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('858bd0a1-9ee5-49c8-ac77-f218758ad913',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.801504] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.801660] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.801735] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.801935] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.802055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.802153] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1068186a-ec83-4273-b088-3f5610ae229e already deleted. [ 679.802242] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.802396] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.802560] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.802642] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.855554] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c295bc4-49b4-44af-8882-6ff6a0658bf2 [ 679.857251] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.857251] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.857251] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.857251] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.857251] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.857251] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c295bc4-49b4-44af-8882-6ff6a0658bf2 already deleted. [ 679.857251] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c295bc4-49b4-44af-8882-6ff6a0658bf2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.032038] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 in Status: SUCCESS [ 680.032788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.032788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.032788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.032955] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.032955] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.033056] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.033567] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.033695] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.033824] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('162b0750-9392-4d6d-b97a-5ce01d5e0894',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.076267] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.080541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.080541] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ede2ab9-e8b6-4785-8c47-e41e7f44e5d8 with status ACTIVE [ 680.080541] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.080541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.080541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.080541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.080541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.080541] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.080541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.080541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.080541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.080541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.080541] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.080541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.080541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.080541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.080541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.081586] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ede2ab9-e8b6-4785-8c47-e41e7f44e5d8 is going to be updated. [ 680.104995] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.104995] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.104995] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.104995] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.104995] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.104995] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ede2ab9-e8b6-4785-8c47-e41e7f44e5d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.226671] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.227670] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.227821] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.228113] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.228269] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.229198] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 already deleted. [ 680.229250] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.325999] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.327308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.327308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.327308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.327308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.327308] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1068186a-ec83-4273-b088-3f5610ae229e already deleted. [ 680.327308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.373834] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 in Status: SUCCESS [ 680.374154] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.375192] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.375416] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.375616] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.375728] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.375794] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.375942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.376033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.376120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.376208] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f7f9d2e-64a3-4672-969a-45f64c5621d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.540037] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('162b0750-9392-4d6d-b97a-5ce01d5e0894',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.735435] env[69559]: INFO networking_nsxv3.common.synchronization [req-f66e9025-bd03-4404-8264-a5a790e848a9 req-2010c920-48b7-4811-8c6a-4b1c6231e421 tempest-TenantUsagesTestJSON-1204581275 tempest-TenantUsagesTestJSON-1204581275-project-member] Enqueued Resource ID: 5761d173-f944-495b-b5eb-da227deec9b9 with Priority: HIGHEST for action security_group_members [ 680.735870] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5761d173-f944-495b-b5eb-da227deec9b9 with Priority: HIGHEST for action security_group_members [ 680.736199] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-5761d173-f944-495b-b5eb-da227deec9b9 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.736323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.736393] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.736658] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.736817] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.737375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.737375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.737375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.737375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.737375] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5761d173-f944-495b-b5eb-da227deec9b9',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.801068] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 in Status: SUCCESS [ 680.801068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.802198] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.802427] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.804085] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.804085] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.804085] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.804085] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.804085] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.804085] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d3ab8f7-3874-4370-9e84-4a90ecd908d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.878642] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f7f9d2e-64a3-4672-969a-45f64c5621d1 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.878821] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.878883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.879141] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.879605] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.879715] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.879797] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.879984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.880087] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.880194] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.880347] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f7f9d2e-64a3-4672-969a-45f64c5621d1 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.880455] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.880516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.880673] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.880873] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.880925] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.881038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.881160] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.881198] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.881348] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.881391] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f7f9d2e-64a3-4672-969a-45f64c5621d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.994428] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa in Status: SUCCESS [ 680.994734] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.044087] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('162b0750-9392-4d6d-b97a-5ce01d5e0894',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.126929] env[69559]: INFO networking_nsxv3.common.synchronization [None req-3d8e7bfb-c6c4-4c1f-8963-bf957788c8b3 None None] Enqueued Resource ID: 34105d6e-34c0-47a1-93ce-71fd7f8b8443 with Priority: HIGHEST for action port [ 681.127587] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34105d6e-34c0-47a1-93ce-71fd7f8b8443 with Priority: HIGHEST for action port [ 681.129851] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-34105d6e-34c0-47a1-93ce-71fd7f8b8443 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.130086] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34105d6e-34c0-47a1-93ce-71fd7f8b8443" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.130251] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34105d6e-34c0-47a1-93ce-71fd7f8b8443" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.130571] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34105d6e-34c0-47a1-93ce-71fd7f8b8443" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.130648] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34105d6e-34c0-47a1-93ce-71fd7f8b8443',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.241165] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.241165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.241165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.241165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.241165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.241165] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.243872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.243872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.243872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.243872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.243872] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5761d173-f944-495b-b5eb-da227deec9b9 already deleted. [ 681.243872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.270249] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: SUCCESS [ 681.272297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.272604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.272741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.272943] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.273085] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.273162] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.273325] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.273407] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.273494] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.273587] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.275828] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 in Status: SUCCESS [ 681.276029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.276973] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.277184] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.277357] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.277461] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.277524] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.277682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.277738] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.279481] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.279481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.279481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.279481] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.279481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.279481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.279481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.279481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.279481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.280223] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.282045] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.282169] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.282280] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.282524] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.282792] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.283147] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.283147] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.283871] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.284188] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.284352] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 681.284476] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 681.284592] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 681.284715] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 681.284831] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 681.285029] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 681.285237] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 681.287198] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.287422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.287617] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.287694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.287694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.287825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.287908] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.287997] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.303701] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 681.303956] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 681.304228] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 681.304494] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.304925] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-60f28111-36b5-4ad3-ba17-2d0efc522364 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.305191] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-60f28111-36b5-4ad3-ba17-2d0efc522364" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.305381] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-60f28111-36b5-4ad3-ba17-2d0efc522364" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.305834] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-60f28111-36b5-4ad3-ba17-2d0efc522364" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.306069] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60f28111-36b5-4ad3-ba17-2d0efc522364',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.307785] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d3ab8f7-3874-4370-9e84-4a90ecd908d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.384831] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f7f9d2e-64a3-4672-969a-45f64c5621d1: rpc.has_security_group_logging(os_id): False [ 681.402018] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.402263] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.402328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.402616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.402752] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.403086] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.403228] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.403327] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.403564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.403894] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.404071] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.404224] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.404966] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.405286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.405403] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.405685] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.405837] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.405925] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.406179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.406301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.406418] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 is going to be created. [ 681.461417] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.461578] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.461652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.461882] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.462080] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.473442] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 in Status: IN_PROGRESS for 2s [ 681.549023] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.549023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.549023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.549023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.549023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.549023] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 is going to be updated. [ 681.580363] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.580779] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.580779] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.580876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.581085] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.590835] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 in Status: IN_PROGRESS for 2s [ 681.633221] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34105d6e-34c0-47a1-93ce-71fd7f8b8443 [ 681.633511] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.633813] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.633894] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.634256] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.634256] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.634363] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34105d6e-34c0-47a1-93ce-71fd7f8b8443 already deleted. [ 681.634413] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34105d6e-34c0-47a1-93ce-71fd7f8b8443" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.747146] env[69559]: INFO networking_nsxv3.common.synchronization [None req-76691b1c-8283-437c-b92b-9d513e55d7de None None] Enqueued Resource ID: f70c583e-df91-46ce-9e90-185dea4723eb with Priority: HIGHEST for action port [ 681.747415] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f70c583e-df91-46ce-9e90-185dea4723eb with Priority: HIGHEST for action port [ 681.747990] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-f70c583e-df91-46ce-9e90-185dea4723eb taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.748141] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f70c583e-df91-46ce-9e90-185dea4723eb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.748234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f70c583e-df91-46ce-9e90-185dea4723eb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.748509] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f70c583e-df91-46ce-9e90-185dea4723eb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.748623] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f70c583e-df91-46ce-9e90-185dea4723eb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.787439] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.788516] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.788631] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.788782] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.793112] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.809036] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.809258] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.809392] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.809657] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.809812] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.809967] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 60f28111-36b5-4ad3-ba17-2d0efc522364 not found, creating... [ 681.810269] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.810442] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.810563] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.810784] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.810924] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.811230] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.811388] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.811507] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.811715] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.811849] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.811989] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 60f28111-36b5-4ad3-ba17-2d0efc522364 is going to be created. [ 681.813379] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d3ab8f7-3874-4370-9e84-4a90ecd908d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.832023] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.832201] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.832300] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.832574] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.832913] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.833028] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-60f28111-36b5-4ad3-ba17-2d0efc522364" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.252244] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f70c583e-df91-46ce-9e90-185dea4723eb [ 682.252244] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.252244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.252244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.252244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.252244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.252244] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f70c583e-df91-46ce-9e90-185dea4723eb already deleted. [ 682.252244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f70c583e-df91-46ce-9e90-185dea4723eb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.294201] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 73e98fb7-5118-4cdb-830b-497719ecfad4: rpc.has_security_group_logging(os_id): False [ 682.295334] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.296363] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.315088] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.315270] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.315341] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.315588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.315684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.315787] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 is going to be updated. [ 682.318257] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.318445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.318590] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.318938] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.319105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.322816] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.322816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.322816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.322816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.322816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.322816] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 is going to be created. [ 682.353956] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.354173] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.354252] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.354509] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.354742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.364283] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 in Status: IN_PROGRESS for 2s [ 682.381668] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.381668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.381668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.381822] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.381934] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.392776] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 in Status: IN_PROGRESS for 2s [ 682.712848] env[69559]: INFO networking_nsxv3.common.synchronization [req-f66e9025-bd03-4404-8264-a5a790e848a9 req-e396ef54-5d70-4679-bb15-395b0b371349 service nova] Enqueued Resource ID: 5761d173-f944-495b-b5eb-da227deec9b9 with Priority: HIGHEST for action security_group_rules [ 682.713045] env[69559]: INFO networking_nsxv3.common.synchronization [req-f66e9025-bd03-4404-8264-a5a790e848a9 req-e396ef54-5d70-4679-bb15-395b0b371349 service nova] Enqueued Resource ID: 5761d173-f944-495b-b5eb-da227deec9b9 with Priority: HIGHEST for action security_group_members [ 682.713186] env[69559]: INFO networking_nsxv3.common.synchronization [req-f66e9025-bd03-4404-8264-a5a790e848a9 req-e396ef54-5d70-4679-bb15-395b0b371349 service nova] Enqueued Resource ID: 60f28111-36b5-4ad3-ba17-2d0efc522364 with Priority: HIGHEST for action port [ 682.713412] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5761d173-f944-495b-b5eb-da227deec9b9 with Priority: HIGHEST for action security_group_rules [ 682.713537] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5761d173-f944-495b-b5eb-da227deec9b9 with Priority: HIGHEST for action security_group_members [ 682.713633] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60f28111-36b5-4ad3-ba17-2d0efc522364 with Priority: HIGHEST for action port [ 682.716451] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5761d173-f944-495b-b5eb-da227deec9b9 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.718863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.718863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.718863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.718863] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5761d173-f944-495b-b5eb-da227deec9b9',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.718863] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-5761d173-f944-495b-b5eb-da227deec9b9 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.718863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.718863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.718863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.718863] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.718863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.718863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.718863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.718863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.721085] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5761d173-f944-495b-b5eb-da227deec9b9',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.721085] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-60f28111-36b5-4ad3-ba17-2d0efc522364 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.721085] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60f28111-36b5-4ad3-ba17-2d0efc522364" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.721085] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60f28111-36b5-4ad3-ba17-2d0efc522364" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.721085] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60f28111-36b5-4ad3-ba17-2d0efc522364" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.722424] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60f28111-36b5-4ad3-ba17-2d0efc522364',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.798734] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.800032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.800265] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.800603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.801480] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.803635] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 is going to be updated. [ 682.803635] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.803635] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.803635] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.803635] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.803635] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.803635] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 is going to be updated. [ 682.845333] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.845333] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.845333] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.845333] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.845333] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.845333] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.847651] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.847839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.848132] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.850107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.859207] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 in Status: IN_PROGRESS for 2s [ 682.860330] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: IN_PROGRESS for 2s [ 682.937462] env[69559]: INFO networking_nsxv3.common.synchronization [req-6f2c33ee-bb7f-4b4a-a34a-3ea956306c4c req-bc066039-d639-4d58-939a-3734cc217eed tempest-ServersWithSpecificFlavorTestJSON-1886354194 tempest-ServersWithSpecificFlavorTestJSON-1886354194-project-member] Enqueued Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGHEST for action security_group_members [ 682.938073] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGHEST for action security_group_members [ 682.938476] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-38ad73d3-d173-4ff2-9e1d-72777311ba4d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.938632] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.938706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.938948] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.944370] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.944557] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.944649] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.944801] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.944898] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.945036] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.224940] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60f28111-36b5-4ad3-ba17-2d0efc522364 with status ACTIVE [ 683.225242] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.225389] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.225458] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.227512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.227512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.227512] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.227512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.227512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.227512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.227512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.227512] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.227512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.227512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.227512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.227512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.228025] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60f28111-36b5-4ad3-ba17-2d0efc522364 is going to be updated. [ 683.229658] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-5761d173-f944-495b-b5eb-da227deec9b9 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.229781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.229933] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5761d173-f944-495b-b5eb-da227deec9b9',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.264337] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.264550] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.264595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.264805] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.264936] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.265156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60f28111-36b5-4ad3-ba17-2d0efc522364" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.447340] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.447679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.447679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.447848] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.447891] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.448088] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.448213] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.448258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.448404] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.448482] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.448575] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d already deleted. [ 683.448655] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.483063] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 in Status: SUCCESS [ 683.483451] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.600819] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 in Status: SUCCESS [ 683.601195] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.601568] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.601837] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.602151] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.602367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.602484] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.602746] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.602914] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.603157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.603313] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('162b0750-9392-4d6d-b97a-5ce01d5e0894',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.733272] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5761d173-f944-495b-b5eb-da227deec9b9',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.800139] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-650 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.802421] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-650" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.802421] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-650" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.802421] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-650" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.802421] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.802421] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.802421] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.802421] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.802421] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.802984] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.802984] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.802984] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.802984] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.803228] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.803228] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.803340] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.821758] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.822155] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 683.822631] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.822959] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-650" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.824673] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-e4040834-83ad-43b4-9eb7-ebdca67831b4 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.824673] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-e4040834-83ad-43b4-9eb7-ebdca67831b4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.824673] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-e4040834-83ad-43b4-9eb7-ebdca67831b4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.824903] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-e4040834-83ad-43b4-9eb7-ebdca67831b4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.825029] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4040834-83ad-43b4-9eb7-ebdca67831b4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.106616] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('162b0750-9392-4d6d-b97a-5ce01d5e0894',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.235788] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.237718] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.238107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.238408] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.238569] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.238685] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5761d173-f944-495b-b5eb-da227deec9b9 is going to be created. [ 684.265782] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.266217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.267792] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.268190] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.268547] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.281648] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5761d173-f944-495b-b5eb-da227deec9b9 in Status: UNINITIALIZED for 2s [ 684.329363] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.330993] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.331308] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.331946] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.337022] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.337022] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port e4040834-83ad-43b4-9eb7-ebdca67831b4 not found, creating... [ 684.337022] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.337022] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.337022] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.337022] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.337022] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.337022] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.337022] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.337022] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.337794] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.337794] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.337794] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: e4040834-83ad-43b4-9eb7-ebdca67831b4 is going to be created. [ 684.356413] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.362229] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.362229] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.362229] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.362229] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.362229] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-e4040834-83ad-43b4-9eb7-ebdca67831b4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.373628] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 in Status: SUCCESS [ 684.374668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.375513] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.375885] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.376197] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.376450] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.376654] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.377010] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.377236] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.377440] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.377648] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d3ab8f7-3874-4370-9e84-4a90ecd908d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.408503] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 in Status: SUCCESS [ 684.408503] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.408503] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.408503] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.408503] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.608437] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 162b0750-9392-4d6d-b97a-5ce01d5e0894: rpc.has_security_group_logging(os_id): False [ 684.625703] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.626944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.626944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.626944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.626944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.626944] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.626944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.626944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.626944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.628516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.628516] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 is going to be created. [ 684.675026] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.675282] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.675711] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.676271] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.676271] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.688036] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 in Status: IN_PROGRESS for 2s [ 684.871301] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 in Status: SUCCESS [ 684.871301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.871435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.871642] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.871829] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.871948] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.872020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.872170] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.872252] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.872347] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.873741] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: SUCCESS [ 684.873896] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.874042] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.874654] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.874654] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.874654] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.874654] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.874654] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.875430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.875430] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.880342] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.880439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.880572] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.880665] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.880795] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.880885] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.880945] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.881098] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.881204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.881249] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.881388] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.881477] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.881532] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.881680] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.881791] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.881876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.881929] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.882069] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.882143] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.882698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.882698] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d3ab8f7-3874-4370-9e84-4a90ecd908d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.910242] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-73e98fb7-5118-4cdb-830b-497719ecfad4 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.910378] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.284012] env[69559]: INFO networking_nsxv3.common.synchronization [req-6f2c33ee-bb7f-4b4a-a34a-3ea956306c4c req-2dd22e80-5fff-4a38-a45c-d60d8ae8ef2b service nova] Enqueued Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGHEST for action security_group_rules [ 685.284224] env[69559]: INFO networking_nsxv3.common.synchronization [req-6f2c33ee-bb7f-4b4a-a34a-3ea956306c4c req-2dd22e80-5fff-4a38-a45c-d60d8ae8ef2b service nova] Enqueued Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGHEST for action security_group_members [ 685.284369] env[69559]: INFO networking_nsxv3.common.synchronization [req-6f2c33ee-bb7f-4b4a-a34a-3ea956306c4c req-2dd22e80-5fff-4a38-a45c-d60d8ae8ef2b service nova] Enqueued Resource ID: e4040834-83ad-43b4-9eb7-ebdca67831b4 with Priority: HIGHEST for action port [ 685.284864] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGHEST for action security_group_rules [ 685.284995] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGHEST for action security_group_members [ 685.285137] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4040834-83ad-43b4-9eb7-ebdca67831b4 with Priority: HIGHEST for action port [ 685.285403] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.285530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.285598] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.285799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.285880] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.287897] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-38ad73d3-d173-4ff2-9e1d-72777311ba4d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.288010] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.288111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.288248] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.288438] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.288519] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.288594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.288743] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.288830] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.288928] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.289624] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4040834-83ad-43b4-9eb7-ebdca67831b4 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.289760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4040834-83ad-43b4-9eb7-ebdca67831b4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.289861] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4040834-83ad-43b4-9eb7-ebdca67831b4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.290372] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4040834-83ad-43b4-9eb7-ebdca67831b4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.290487] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4040834-83ad-43b4-9eb7-ebdca67831b4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.377435] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.378205] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.388028] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d3ab8f7-3874-4370-9e84-4a90ecd908d1: rpc.has_security_group_logging(os_id): False [ 685.406444] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.406651] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.406742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.406961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.407082] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.407356] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.407495] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.407556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.407723] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.407814] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.408032] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.408131] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.408186] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.408333] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.408410] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.408587] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.408679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.408737] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.408898] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.408976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.409074] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 is going to be updated. [ 685.468942] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.469121] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.469191] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.469371] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.469578] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.480813] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 in Status: IN_PROGRESS for 2s [ 685.793235] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.794353] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-38ad73d3-d173-4ff2-9e1d-72777311ba4d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.794478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.794640] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4040834-83ad-43b4-9eb7-ebdca67831b4 with status ACTIVE [ 685.794802] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.794918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.794979] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.795331] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.795395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.795530] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.795632] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.795689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.796792] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.796792] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.796792] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.796949] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.796949] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.797142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.797239] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.797327] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4040834-83ad-43b4-9eb7-ebdca67831b4 is going to be updated. [ 685.819150] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.819150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.819150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.819150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.819150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.819150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4040834-83ad-43b4-9eb7-ebdca67831b4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.881948] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.881948] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.290992] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5761d173-f944-495b-b5eb-da227deec9b9 in Status: SUCCESS [ 686.293323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.293323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.293323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.293323] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.293323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.293323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.293323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.293323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.293323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.293323] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5761d173-f944-495b-b5eb-da227deec9b9',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.296459] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.385233] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.385233] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.385233] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.385454] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.385648] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.385813] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 is going to be updated. [ 686.388437] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.388555] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.388628] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.388799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.388882] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.388972] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 is going to be updated. [ 686.419626] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.419626] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.419626] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.419626] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.419626] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.421835] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.421835] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.421835] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.421835] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.422422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.433384] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 in Status: IN_PROGRESS for 2s [ 686.434288] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: IN_PROGRESS for 2s [ 686.701119] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 in Status: SUCCESS [ 686.701389] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.798688] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-5761d173-f944-495b-b5eb-da227deec9b9 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.798688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.798688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.798688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.798688] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.798688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.798688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.798688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.798688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.798688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.798688] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-5761d173-f944-495b-b5eb-da227deec9b9 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.798688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.799449] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.799449] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.799449] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.799449] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.799449] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.799691] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.799691] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.799756] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.799816] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5761d173-f944-495b-b5eb-da227deec9b9',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.801129] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.801269] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.801349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.801529] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.801621] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.801717] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d is going to be created. [ 686.824990] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.825478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.825557] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.825770] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.825930] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.836012] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d in Status: UNINITIALIZED for 2s [ 687.303672] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5761d173-f944-495b-b5eb-da227deec9b9: rpc.has_security_group_logging(os_id): False [ 687.323344] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.323344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.323344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.323344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.323344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.323344] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.323344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.323344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.323778] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.323778] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.323778] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.323901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.323901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.324052] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.324116] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.324319] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.324411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.324472] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.325246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.325246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.325246] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5761d173-f944-495b-b5eb-da227deec9b9 is going to be created. [ 687.381623] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.381739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.381797] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.382043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.382195] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.392100] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5761d173-f944-495b-b5eb-da227deec9b9 in Status: IN_PROGRESS for 2s [ 687.501416] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 in Status: SUCCESS [ 687.501742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.445846] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: SUCCESS [ 688.446261] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.446910] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 in Status: SUCCESS [ 688.447099] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.447330] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.447522] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.447793] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.447858] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.447906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.448083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.448225] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.448336] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.448516] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.448613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.448676] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.449012] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.449087] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.449143] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.449212] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.449355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.449432] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.449532] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.449624] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.450708] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.450874] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.451036] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.451139] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.451209] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.451348] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.451425] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.451507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.451594] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.848864] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d in Status: SUCCESS [ 688.849342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.849636] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.849955] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.850262] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.851748] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.851748] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.851748] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.851748] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.851748] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.851748] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.953219] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 392028d0-93e9-4420-8ca7-d3fa218b5c83: rpc.has_security_group_logging(os_id): False [ 688.955047] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.970224] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.971366] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.971366] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.972385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.972385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.972385] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.972385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.972385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.972385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.972385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.972683] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.972683] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.972683] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.972806] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.972878] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.973140] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.973232] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.973232] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.973601] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.973760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.973877] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 is going to be updated. [ 689.037118] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.037118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.037118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.039032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.039032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.050933] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: IN_PROGRESS for 2s [ 689.126240] env[69559]: INFO networking_nsxv3.common.synchronization [req-b8c011ea-15b3-498b-b681-321655b8827c req-f90f344f-0d1c-461a-97f0-2a13472b8edb tempest-ServerDiagnosticsTest-166480050 tempest-ServerDiagnosticsTest-166480050-project-member] Enqueued Resource ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa with Priority: HIGHEST for action security_group_members [ 689.127298] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa with Priority: HIGHEST for action security_group_members [ 689.127298] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-825fa80b-a9de-4b97-ae04-49c19c2e9faa taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.127298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.127298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.127298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.127583] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.127583] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.127670] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.127775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.127821] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.127909] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('825fa80b-a9de-4b97-ae04-49c19c2e9faa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.353955] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.406988] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5761d173-f944-495b-b5eb-da227deec9b9 in Status: SUCCESS [ 689.406988] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.459773] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 73e98fb7-5118-4cdb-830b-497719ecfad4: rpc.has_security_group_logging(os_id): False [ 689.477231] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.477464] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.477464] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.479713] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.479900] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.480141] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.480377] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.480445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.480672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.480730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.480809] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 is going to be updated. [ 689.529314] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.529314] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.529314] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.529578] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.529578] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.545089] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 in Status: IN_PROGRESS for 2s [ 689.630770] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.630961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.631046] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.631311] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.631455] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.631603] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.631708] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.631762] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.631946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.632075] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.632171] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa is going to be updated. [ 689.667500] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.667720] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.667828] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.668220] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.668433] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.678624] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa in Status: IN_PROGRESS for 2s [ 689.723319] env[69559]: INFO networking_nsxv3.common.synchronization [None req-8b62f08e-aca4-4982-83fe-2954d29387f0 None None] Enqueued Resource ID: 56ab57cb-56ab-48da-a859-135fc692956b with Priority: HIGHEST for action port [ 689.723554] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56ab57cb-56ab-48da-a859-135fc692956b with Priority: HIGHEST for action port [ 689.726029] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-56ab57cb-56ab-48da-a859-135fc692956b taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.726029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56ab57cb-56ab-48da-a859-135fc692956b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.726029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56ab57cb-56ab-48da-a859-135fc692956b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.726029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56ab57cb-56ab-48da-a859-135fc692956b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.726029] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56ab57cb-56ab-48da-a859-135fc692956b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.856814] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38ad73d3-d173-4ff2-9e1d-72777311ba4d: rpc.has_security_group_logging(os_id): False [ 689.874126] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.874327] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.874398] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.874614] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.874702] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.874953] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.875077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.875176] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.875532] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.875680] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.875856] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d is going to be created. [ 689.928919] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.929130] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.929179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.929430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.929641] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.938843] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d in Status: IN_PROGRESS for 2s [ 690.227864] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56ab57cb-56ab-48da-a859-135fc692956b [ 690.228058] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.228210] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.228348] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.229027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.229027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.229027] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56ab57cb-56ab-48da-a859-135fc692956b already deleted. [ 690.229027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56ab57cb-56ab-48da-a859-135fc692956b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.066477] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: SUCCESS [ 691.066754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.067016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.068344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.068344] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.490186] env[69559]: INFO networking_nsxv3.common.synchronization [None req-ba45dfe6-b227-4a9a-8733-8c88cce0db5e None None] Enqueued Resource ID: 266de267-9d6c-4933-8767-0a136b2d2e86 with Priority: HIGHEST for action port [ 691.490186] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 266de267-9d6c-4933-8767-0a136b2d2e86 with Priority: HIGHEST for action port [ 691.490186] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-266de267-9d6c-4933-8767-0a136b2d2e86 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.490186] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-266de267-9d6c-4933-8767-0a136b2d2e86" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.490186] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-266de267-9d6c-4933-8767-0a136b2d2e86" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.490186] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-266de267-9d6c-4933-8767-0a136b2d2e86" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.490186] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('266de267-9d6c-4933-8767-0a136b2d2e86',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.562915] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 in Status: SUCCESS [ 691.563398] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.570927] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.570927] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.570927] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.571121] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.571604] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.571604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.571604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.571604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.571791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.571791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.571867] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.689271] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa in Status: SUCCESS [ 691.689327] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa deletion is rescheduled due to dependency. [ 691.689456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.953423] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d in Status: SUCCESS [ 691.953423] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.960257] env[69559]: INFO networking_nsxv3.common.synchronization [None req-b48973fd-4c8f-4662-99de-66ce72b5be23 None None] Enqueued Resource ID: c226aef9-16e0-4598-a3db-7a21e563ee37 with Priority: HIGHEST for action port [ 691.960257] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c226aef9-16e0-4598-a3db-7a21e563ee37 with Priority: HIGHEST for action port [ 691.960257] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-c226aef9-16e0-4598-a3db-7a21e563ee37 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.960257] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c226aef9-16e0-4598-a3db-7a21e563ee37" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.960257] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c226aef9-16e0-4598-a3db-7a21e563ee37" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.960257] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c226aef9-16e0-4598-a3db-7a21e563ee37" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.960257] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c226aef9-16e0-4598-a3db-7a21e563ee37',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.993258] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 266de267-9d6c-4933-8767-0a136b2d2e86 [ 691.995515] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.995515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.995515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.995515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.995515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.995515] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:266de267-9d6c-4933-8767-0a136b2d2e86 already deleted. [ 691.995515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-266de267-9d6c-4933-8767-0a136b2d2e86" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.075532] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.075816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.075816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.076029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.076239] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.076412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.076491] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.076700] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.076808] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.076902] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.077257] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.078017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.078017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.078017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.078017] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.078017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.078017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.078306] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.078306] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.078375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.078423] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.462543] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c226aef9-16e0-4598-a3db-7a21e563ee37 [ 692.462777] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.462989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.462989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.464432] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.464432] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.464432] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c226aef9-16e0-4598-a3db-7a21e563ee37 already deleted. [ 692.464432] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c226aef9-16e0-4598-a3db-7a21e563ee37" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.581792] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 392028d0-93e9-4420-8ca7-d3fa218b5c83: rpc.has_security_group_logging(os_id): False [ 692.607758] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.607915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.607988] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.608230] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.608361] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.609092] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.609092] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.609092] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.610164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.610164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.610164] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.610164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.610164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.610470] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.610470] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.611150] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.611150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.611150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.611150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.611150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.611375] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 is going to be updated. [ 692.675543] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.675543] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.675543] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.675543] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.675543] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.691716] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: IN_PROGRESS for 2s [ 692.766438] env[69559]: INFO networking_nsxv3.common.synchronization [None req-f6641353-206d-4141-86f4-8768552fa036 tempest-ServersTestFqdnHostnames-1882326979 tempest-ServersTestFqdnHostnames-1882326979-project-member] Enqueued Resource ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 with Priority: HIGHEST for action security_group_rules [ 692.766840] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 with Priority: HIGHEST for action security_group_rules [ 692.767566] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2d4f121-303e-4c6b-ac7a-e595df5750d8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.767711] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.767759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.768144] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.768274] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2d4f121-303e-4c6b-ac7a-e595df5750d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.839016] env[69559]: INFO networking_nsxv3.common.synchronization [None req-e0e24a45-9545-4bce-a40f-3281f27bb34b None None] Enqueued Resource ID: 48f8fd2d-47e3-4419-8c08-9c88a8e43133 with Priority: HIGHEST for action port [ 692.840248] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48f8fd2d-47e3-4419-8c08-9c88a8e43133 with Priority: HIGHEST for action port [ 692.840248] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-48f8fd2d-47e3-4419-8c08-9c88a8e43133 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.840248] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48f8fd2d-47e3-4419-8c08-9c88a8e43133" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.840248] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48f8fd2d-47e3-4419-8c08-9c88a8e43133" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.840963] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48f8fd2d-47e3-4419-8c08-9c88a8e43133" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.841062] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48f8fd2d-47e3-4419-8c08-9c88a8e43133',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.896536] env[69559]: INFO networking_nsxv3.common.synchronization [None req-e8a92b61-180c-4dc0-8c85-7f8cf8a0aec9 tempest-ServersTestFqdnHostnames-1882326979 tempest-ServersTestFqdnHostnames-1882326979-project-member] Enqueued Resource ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 with Priority: HIGHEST for action security_group_rules [ 692.897095] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 with Priority: HIGHEST for action security_group_rules [ 692.897477] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2d4f121-303e-4c6b-ac7a-e595df5750d8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.897610] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.291897] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.291897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.291897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.291897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.291897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.292350] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 already deleted. [ 693.292350] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.292350] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.292458] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.292458] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2d4f121-303e-4c6b-ac7a-e595df5750d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.344477] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48f8fd2d-47e3-4419-8c08-9c88a8e43133 [ 693.344477] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.344477] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.344950] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.344950] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.344950] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.344950] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48f8fd2d-47e3-4419-8c08-9c88a8e43133 already deleted. [ 693.345110] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48f8fd2d-47e3-4419-8c08-9c88a8e43133" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.817384] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.817598] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.817711] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.817970] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.818149] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.818317] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 already deleted. [ 693.818444] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.283273] env[69559]: INFO networking_nsxv3.common.synchronization [None req-08e514b0-3a4e-416d-8c3c-04845c257473 None None] Enqueued Resource ID: 43d4104e-3ab3-49aa-9a5e-2df58c31225c with Priority: HIGHEST for action port [ 694.283273] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43d4104e-3ab3-49aa-9a5e-2df58c31225c with Priority: HIGHEST for action port [ 694.287920] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-43d4104e-3ab3-49aa-9a5e-2df58c31225c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.288068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43d4104e-3ab3-49aa-9a5e-2df58c31225c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.288137] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43d4104e-3ab3-49aa-9a5e-2df58c31225c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.288480] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43d4104e-3ab3-49aa-9a5e-2df58c31225c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.289010] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43d4104e-3ab3-49aa-9a5e-2df58c31225c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.706493] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: SUCCESS [ 694.706917] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.782143] env[69559]: INFO networking_nsxv3.common.synchronization [None req-16457366-a10e-4d42-a057-29b1e744cafe None None] Enqueued Resource ID: 4e8c2a74-3ebf-4ae0-a11e-207b4e0a424c with Priority: HIGHEST for action port [ 694.782486] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e8c2a74-3ebf-4ae0-a11e-207b4e0a424c with Priority: HIGHEST for action port [ 694.783343] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e8c2a74-3ebf-4ae0-a11e-207b4e0a424c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.784211] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e8c2a74-3ebf-4ae0-a11e-207b4e0a424c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.784211] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e8c2a74-3ebf-4ae0-a11e-207b4e0a424c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.784211] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e8c2a74-3ebf-4ae0-a11e-207b4e0a424c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.784211] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e8c2a74-3ebf-4ae0-a11e-207b4e0a424c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.791310] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 43d4104e-3ab3-49aa-9a5e-2df58c31225c [ 694.791310] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.791310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.791310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.791818] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.791933] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.792083] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:43d4104e-3ab3-49aa-9a5e-2df58c31225c already deleted. [ 694.792171] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43d4104e-3ab3-49aa-9a5e-2df58c31225c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.146095] env[69559]: INFO networking_nsxv3.common.synchronization [None req-1fa8ea90-9cf8-4e62-b43d-d13ebf53b3a3 tempest-VolumesAdminNegativeTest-1895972689 tempest-VolumesAdminNegativeTest-1895972689-project-member] Enqueued Resource ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e with Priority: HIGHEST for action security_group_rules [ 695.146743] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e with Priority: HIGHEST for action security_group_rules [ 695.146948] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.150450] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.150450] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.150450] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.150450] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acb5a9fe-3650-403a-90f4-19ec52b5f97e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.286454] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e8c2a74-3ebf-4ae0-a11e-207b4e0a424c [ 695.286700] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.286865] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.286916] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.287156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.287262] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.287377] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e8c2a74-3ebf-4ae0-a11e-207b4e0a424c already deleted. [ 695.287475] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e8c2a74-3ebf-4ae0-a11e-207b4e0a424c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.600975] env[69559]: INFO networking_nsxv3.common.synchronization [None req-8f9df9df-a6d2-47b2-a9d6-9ade0ce62c1f tempest-VolumesAdminNegativeTest-1895972689 tempest-VolumesAdminNegativeTest-1895972689-project-member] Enqueued Resource ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e with Priority: HIGHEST for action security_group_rules [ 695.602245] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e with Priority: HIGHEST for action security_group_rules [ 695.602616] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.602837] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.672771] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.672771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.672971] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.673133] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.673226] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.673300] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e already deleted. [ 695.673386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.673574] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.673746] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.673891] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acb5a9fe-3650-403a-90f4-19ec52b5f97e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.210884] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.210884] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.210884] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.210884] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.211282] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.211282] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e already deleted. [ 696.211282] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.193509] env[69559]: INFO networking_nsxv3.common.synchronization [None req-ed05508a-444a-40b0-9d4c-09dbfaf448fd None None] Enqueued Resource ID: 46f2fddd-b4d9-4348-8b1e-1e5e2610fa38 with Priority: HIGHEST for action port [ 698.194572] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46f2fddd-b4d9-4348-8b1e-1e5e2610fa38 with Priority: HIGHEST for action port [ 698.196014] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-46f2fddd-b4d9-4348-8b1e-1e5e2610fa38 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.196138] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46f2fddd-b4d9-4348-8b1e-1e5e2610fa38" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.196228] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46f2fddd-b4d9-4348-8b1e-1e5e2610fa38" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.196627] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46f2fddd-b4d9-4348-8b1e-1e5e2610fa38" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.196730] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46f2fddd-b4d9-4348-8b1e-1e5e2610fa38',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.699943] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 46f2fddd-b4d9-4348-8b1e-1e5e2610fa38 [ 698.700251] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.700400] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.700480] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.700683] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.700774] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.700869] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:46f2fddd-b4d9-4348-8b1e-1e5e2610fa38 already deleted. [ 698.700952] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46f2fddd-b4d9-4348-8b1e-1e5e2610fa38" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.718201] env[69559]: INFO networking_nsxv3.common.synchronization [None req-dfbc5f83-664f-414e-8df5-63366dc000e1 tempest-ServerActionsTestOtherA-1414477814 tempest-ServerActionsTestOtherA-1414477814-project-member] Enqueued Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGHEST for action security_group_rules [ 698.718739] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGHEST for action security_group_rules [ 698.720062] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-531bc278-c746-4ada-9fc4-704b99519eae taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.720330] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.720422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.720624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.720713] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.841147] env[69559]: INFO networking_nsxv3.common.synchronization [req-c3fa814c-06bb-4f5e-9b6a-8f8f039af579 req-9d1a255b-0aa6-454e-8266-d15c93f55fec tempest-TenantUsagesTestJSON-1204581275 tempest-TenantUsagesTestJSON-1204581275-project-member] Enqueued Resource ID: 5761d173-f944-495b-b5eb-da227deec9b9 with Priority: HIGHEST for action security_group_members [ 698.841742] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5761d173-f944-495b-b5eb-da227deec9b9 with Priority: HIGHEST for action security_group_members [ 698.842113] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-5761d173-f944-495b-b5eb-da227deec9b9 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.842243] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.842325] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.842517] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.842670] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.842770] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.842833] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.842981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.843085] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.843181] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5761d173-f944-495b-b5eb-da227deec9b9',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.850542] env[69559]: INFO networking_nsxv3.common.synchronization [None req-31b6f508-bdec-4eee-8e85-e3e4260b9da6 tempest-ServerActionsTestOtherA-1414477814 tempest-ServerActionsTestOtherA-1414477814-project-member] Enqueued Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGHEST for action security_group_rules [ 698.851246] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGHEST for action security_group_rules [ 698.851865] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-531bc278-c746-4ada-9fc4-704b99519eae taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.851865] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.869821] env[69559]: INFO networking_nsxv3.common.synchronization [req-910882d6-d7b4-49df-83e6-ee18bed1ab6b req-9d81adfc-b5d4-4009-84c4-274798d1d2a0 tempest-ServersAdminTestJSON-1923717545 tempest-ServersAdminTestJSON-1923717545-project-member] Enqueued Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 698.870091] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 698.870611] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.870803] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.870803] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.870997] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.871369] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.871529] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.873249] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.873249] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.873249] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.873249] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.244518] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.244518] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.244518] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.244518] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.245146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.245146] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 531bc278-c746-4ada-9fc4-704b99519eae already deleted. [ 699.245146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.245656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.245656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.246488] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.344878] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.345085] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.345189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.345435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.345588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.345785] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.345893] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.345954] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.346118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.346197] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.346587] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5761d173-f944-495b-b5eb-da227deec9b9 is going to be updated. [ 699.363044] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.363241] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-517" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.363369] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-517" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.363639] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-517" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.363941] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.364056] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.364172] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.364395] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.364536] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.364746] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.364850] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 699.364959] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 699.366992] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 699.370914] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.370914] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 699.370914] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 699.376543] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.378280] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.378510] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.378577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.378755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.378890] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.389398] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 699.389398] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 699.389398] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 699.389398] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-517" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.389398] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-9d32b465-73cd-4c87-8cde-e213aec974ae taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.389736] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-9d32b465-73cd-4c87-8cde-e213aec974ae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.389736] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-9d32b465-73cd-4c87-8cde-e213aec974ae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.389951] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-9d32b465-73cd-4c87-8cde-e213aec974ae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.390748] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d32b465-73cd-4c87-8cde-e213aec974ae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.391834] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5761d173-f944-495b-b5eb-da227deec9b9 in Status: IN_PROGRESS for 2s [ 699.767112] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.767112] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.767112] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.767375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.767407] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.767542] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 531bc278-c746-4ada-9fc4-704b99519eae already deleted. [ 699.767899] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.881718] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.894059] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.894484] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.895672] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.896044] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.896214] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.896517] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 9d32b465-73cd-4c87-8cde-e213aec974ae not found, creating... [ 699.896693] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.896867] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.896991] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.897493] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.897638] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.898060] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.898751] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.898896] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.899294] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.899374] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.899670] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 9d32b465-73cd-4c87-8cde-e213aec974ae is going to be created. [ 699.921287] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.921287] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.921287] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.921287] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.921287] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.921287] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-9d32b465-73cd-4c87-8cde-e213aec974ae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.384216] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.384599] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.384599] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.384840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.384840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.384840] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fab5e96-3f01-4c71-994f-69059ca62986 is going to be updated. [ 700.418203] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.418203] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.418203] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.418203] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.418203] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.429024] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: IN_PROGRESS for 2s [ 700.568186] env[69559]: INFO networking_nsxv3.common.synchronization [None req-7f3c07f8-43e3-4179-9527-d60c99c423d9 None None] Enqueued Resource ID: 91200878-c712-4e2b-abb6-e166b01e7d7b with Priority: HIGHEST for action port [ 700.568186] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91200878-c712-4e2b-abb6-e166b01e7d7b with Priority: HIGHEST for action port [ 700.568186] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-91200878-c712-4e2b-abb6-e166b01e7d7b taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.568186] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91200878-c712-4e2b-abb6-e166b01e7d7b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.568186] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91200878-c712-4e2b-abb6-e166b01e7d7b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.569326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91200878-c712-4e2b-abb6-e166b01e7d7b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.569326] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91200878-c712-4e2b-abb6-e166b01e7d7b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.779794] env[69559]: INFO networking_nsxv3.common.synchronization [req-910882d6-d7b4-49df-83e6-ee18bed1ab6b req-0085e32b-cf61-4b48-a79d-e813c042aa85 service nova] Enqueued Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_rules [ 700.779998] env[69559]: INFO networking_nsxv3.common.synchronization [req-910882d6-d7b4-49df-83e6-ee18bed1ab6b req-0085e32b-cf61-4b48-a79d-e813c042aa85 service nova] Enqueued Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 700.780154] env[69559]: INFO networking_nsxv3.common.synchronization [req-910882d6-d7b4-49df-83e6-ee18bed1ab6b req-0085e32b-cf61-4b48-a79d-e813c042aa85 service nova] Enqueued Resource ID: 9d32b465-73cd-4c87-8cde-e213aec974ae with Priority: HIGHEST for action port [ 700.780385] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_rules [ 700.780515] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 700.780611] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d32b465-73cd-4c87-8cde-e213aec974ae with Priority: HIGHEST for action port [ 700.783577] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.783577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.783577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.783577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.783577] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.783577] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.783577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.785052] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d32b465-73cd-4c87-8cde-e213aec974ae taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.785052] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d32b465-73cd-4c87-8cde-e213aec974ae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.785052] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d32b465-73cd-4c87-8cde-e213aec974ae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.785052] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d32b465-73cd-4c87-8cde-e213aec974ae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.785052] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d32b465-73cd-4c87-8cde-e213aec974ae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.071544] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91200878-c712-4e2b-abb6-e166b01e7d7b [ 701.071848] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.072174] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.072174] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.072333] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.072468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.072562] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91200878-c712-4e2b-abb6-e166b01e7d7b already deleted. [ 701.072669] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91200878-c712-4e2b-abb6-e166b01e7d7b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.287817] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.288016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.288163] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d32b465-73cd-4c87-8cde-e213aec974ae with status ACTIVE [ 701.288429] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.288549] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.288632] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.288855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.288945] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.289132] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.289226] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.289289] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.289444] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.289525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.289721] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.289858] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.289900] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.290040] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.290119] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.290205] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d32b465-73cd-4c87-8cde-e213aec974ae is going to be updated. [ 701.310292] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.310460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.310532] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.310772] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.310907] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.311095] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d32b465-73cd-4c87-8cde-e213aec974ae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.401068] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5761d173-f944-495b-b5eb-da227deec9b9 in Status: SUCCESS [ 701.401295] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5761d173-f944-495b-b5eb-da227deec9b9 deletion is rescheduled due to dependency. [ 701.401377] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.439328] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: SUCCESS [ 702.439586] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.439740] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.439976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.440147] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.440277] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.440331] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.440661] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.440661] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.440661] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.943433] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.448106] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.950717] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.951030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.951176] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.951328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.951476] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.951622] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fab5e96-3f01-4c71-994f-69059ca62986 is going to be updated. [ 703.979816] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.979957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.980072] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.980270] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.980411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.991990] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: IN_PROGRESS for 2s [ 704.963461] env[69559]: INFO networking_nsxv3.common.synchronization [None req-b1cc7154-b59d-467f-bba7-536ac0549095 None None] Enqueued Resource ID: 18d277d6-3f66-4541-932e-1685de7027d9 with Priority: HIGHEST for action port [ 704.963461] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18d277d6-3f66-4541-932e-1685de7027d9 with Priority: HIGHEST for action port [ 704.963461] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-18d277d6-3f66-4541-932e-1685de7027d9 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.963461] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18d277d6-3f66-4541-932e-1685de7027d9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.963461] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18d277d6-3f66-4541-932e-1685de7027d9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.964127] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18d277d6-3f66-4541-932e-1685de7027d9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.964295] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18d277d6-3f66-4541-932e-1685de7027d9',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.468143] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18d277d6-3f66-4541-932e-1685de7027d9 [ 705.468143] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.468143] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.468143] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.468143] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.468143] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.468143] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18d277d6-3f66-4541-932e-1685de7027d9 already deleted. [ 705.468143] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18d277d6-3f66-4541-932e-1685de7027d9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.003747] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: SUCCESS [ 706.004044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.004244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.004570] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.004838] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.005270] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.005270] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.005434] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.005538] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.005631] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.005726] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.508821] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.509071] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.509180] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.510262] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.510262] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.510262] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.510262] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.510262] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.510262] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.510262] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.510478] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.510612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.510698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.510871] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.511053] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.511191] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.511277] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.511477] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.511565] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.511680] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.511796] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.966638] env[69559]: INFO networking_nsxv3.common.synchronization [None req-caf4d640-b90d-41d0-9571-5d218befba62 None None] Enqueued Resource ID: 40291589-1f16-4042-b18d-c4cd6000ea95 with Priority: HIGHEST for action port [ 706.966828] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40291589-1f16-4042-b18d-c4cd6000ea95 with Priority: HIGHEST for action port [ 706.967471] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-40291589-1f16-4042-b18d-c4cd6000ea95 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.968090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40291589-1f16-4042-b18d-c4cd6000ea95" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.968090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40291589-1f16-4042-b18d-c4cd6000ea95" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.968090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40291589-1f16-4042-b18d-c4cd6000ea95" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.968090] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40291589-1f16-4042-b18d-c4cd6000ea95',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.016381] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fab5e96-3f01-4c71-994f-69059ca62986: rpc.has_security_group_logging(os_id): False [ 707.031925] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.032262] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.032375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.032772] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.033964] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.034358] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.034686] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.038088] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.039255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.039255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.039255] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.039255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.039447] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.039553] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.039727] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.040725] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.040725] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.040725] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.040725] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.040725] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.040954] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fab5e96-3f01-4c71-994f-69059ca62986 is going to be updated. [ 707.103564] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.103564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.103564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.103564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.103564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.119107] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: IN_PROGRESS for 2s [ 707.471285] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40291589-1f16-4042-b18d-c4cd6000ea95 [ 707.471906] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.471906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.471906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.471906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.472140] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.472140] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40291589-1f16-4042-b18d-c4cd6000ea95 already deleted. [ 707.472200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40291589-1f16-4042-b18d-c4cd6000ea95" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.150014] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: SUCCESS [ 709.150014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.204782] env[69559]: INFO networking_nsxv3.common.synchronization [None req-4db9d0f1-6a09-40c9-8fef-49864e648281 None None] Enqueued Resource ID: fa76bf79-3f1a-4e74-9517-5423f99ed0cd with Priority: HIGHEST for action port [ 709.205045] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa76bf79-3f1a-4e74-9517-5423f99ed0cd with Priority: HIGHEST for action port [ 709.206190] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa76bf79-3f1a-4e74-9517-5423f99ed0cd taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.206190] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa76bf79-3f1a-4e74-9517-5423f99ed0cd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.206190] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa76bf79-3f1a-4e74-9517-5423f99ed0cd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.206361] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa76bf79-3f1a-4e74-9517-5423f99ed0cd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.206361] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa76bf79-3f1a-4e74-9517-5423f99ed0cd',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.631468] env[69559]: INFO networking_nsxv3.common.synchronization [req-5e19d226-305d-4981-a2f9-c1a1903c8c19 req-6f5f32b6-f712-41a3-bcfb-930c1f7aa363 tempest-ServersTestMultiNic-1711850925 tempest-ServersTestMultiNic-1711850925-project-member] Enqueued Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 709.631468] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 709.631585] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.632007] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.633443] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.633748] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.633919] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.634040] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.634098] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.634260] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.634348] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.634443] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.710793] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fa76bf79-3f1a-4e74-9517-5423f99ed0cd [ 709.710793] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.710793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.710793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.710793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.710793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.710793] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fa76bf79-3f1a-4e74-9517-5423f99ed0cd already deleted. [ 709.710793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa76bf79-3f1a-4e74-9517-5423f99ed0cd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.138378] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.138378] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.138378] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.138378] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.138378] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.138378] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.138378] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.138378] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.138378] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.138378] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.138378] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e already deleted. [ 710.138378] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.264986] env[69559]: INFO networking_nsxv3.common.synchronization [None req-6e01d284-9332-4e2a-b00b-bd0770099ad3 tempest-ServersTestBootFromVolume-895220158 tempest-ServersTestBootFromVolume-895220158-project-member] Enqueued Resource ID: 71804139-4bc8-4998-a537-3cd9da947efb with Priority: HIGHEST for action security_group_rules [ 710.266872] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71804139-4bc8-4998-a537-3cd9da947efb with Priority: HIGHEST for action security_group_rules [ 710.270433] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71804139-4bc8-4998-a537-3cd9da947efb taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.272774] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.272774] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.272774] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.272774] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71804139-4bc8-4998-a537-3cd9da947efb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.354939] env[69559]: INFO networking_nsxv3.common.synchronization [None req-02d29280-1642-4cc1-87f8-ecc6493a272e tempest-ServersTestBootFromVolume-895220158 tempest-ServersTestBootFromVolume-895220158-project-member] Enqueued Resource ID: 71804139-4bc8-4998-a537-3cd9da947efb with Priority: HIGHEST for action security_group_rules [ 710.355483] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71804139-4bc8-4998-a537-3cd9da947efb with Priority: HIGHEST for action security_group_rules [ 710.355773] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71804139-4bc8-4998-a537-3cd9da947efb taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.355858] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.430148] env[69559]: INFO networking_nsxv3.common.synchronization [req-5e19d226-305d-4981-a2f9-c1a1903c8c19 req-79191ce7-64d6-4a78-9ea1-8068f8ff0087 tempest-ServersTestMultiNic-1711850925 tempest-ServersTestMultiNic-1711850925-project-member] Enqueued Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 710.430656] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 710.430963] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.434259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.434341] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.434556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.434738] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.434841] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.435200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.435200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.435200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.435408] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.796263] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.796936] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.796936] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.796936] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.796936] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.796936] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71804139-4bc8-4998-a537-3cd9da947efb already deleted. [ 710.797139] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.797323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.797590] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.797710] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71804139-4bc8-4998-a537-3cd9da947efb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.869154] env[69559]: INFO networking_nsxv3.common.synchronization [req-5e19d226-305d-4981-a2f9-c1a1903c8c19 req-048c01a5-07bc-47ee-b6e7-de09a00db37e tempest-ServersTestMultiNic-1711850925 tempest-ServersTestMultiNic-1711850925-project-member] Enqueued Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 710.872836] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 710.872836] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.873023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.937666] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.937931] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.937987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.938724] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.938863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.939161] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.939304] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.939389] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.939672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.939672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.939758] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e already deleted. [ 710.939871] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.940064] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.940259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.940437] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.940571] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.940654] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.940824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.940925] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.941095] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.287975] env[69559]: INFO networking_nsxv3.common.synchronization [None req-07518071-68df-4b45-945d-bd3f98e2a499 None None] Enqueued Resource ID: d58b0ee4-0e95-40f0-931c-0fed04aa08a7 with Priority: HIGHEST for action port [ 711.288269] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d58b0ee4-0e95-40f0-931c-0fed04aa08a7 with Priority: HIGHEST for action port [ 711.288849] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-d58b0ee4-0e95-40f0-931c-0fed04aa08a7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.289039] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d58b0ee4-0e95-40f0-931c-0fed04aa08a7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.289039] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d58b0ee4-0e95-40f0-931c-0fed04aa08a7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.290157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d58b0ee4-0e95-40f0-931c-0fed04aa08a7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.290352] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d58b0ee4-0e95-40f0-931c-0fed04aa08a7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.317520] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.317672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.317743] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.317956] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.318060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.318155] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71804139-4bc8-4998-a537-3cd9da947efb already deleted. [ 711.318238] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.338196] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-373 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.338498] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-373" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.338687] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-373" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.343207] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-373" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.343649] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.343904] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.344104] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.344491] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.344685] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.344983] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 711.345176] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 711.345352] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 711.345527] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 711.345701] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 711.345886] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 711.346103] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 711.366361] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 711.366986] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 711.366986] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 711.367124] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-373" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.367537] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-cec962ae-30f3-44ea-ba7d-b2407a7f034b taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.367799] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-cec962ae-30f3-44ea-ba7d-b2407a7f034b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.368010] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-cec962ae-30f3-44ea-ba7d-b2407a7f034b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.368631] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-cec962ae-30f3-44ea-ba7d-b2407a7f034b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.368766] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cec962ae-30f3-44ea-ba7d-b2407a7f034b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.446116] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.446116] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.446116] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.446116] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.446116] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.446116] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.446116] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.446116] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.446116] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.447218] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.447218] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e already deleted. [ 711.447218] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.796716] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d58b0ee4-0e95-40f0-931c-0fed04aa08a7 [ 711.796716] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.796716] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.796716] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.796716] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.796716] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.796716] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d58b0ee4-0e95-40f0-931c-0fed04aa08a7 already deleted. [ 711.796716] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d58b0ee4-0e95-40f0-931c-0fed04aa08a7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.876049] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.876049] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.876049] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.876049] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.876049] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.876049] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port cec962ae-30f3-44ea-ba7d-b2407a7f034b not found, creating... [ 711.876049] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.876049] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.876049] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.876049] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.876890] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.877446] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.877816] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.878185] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.878580] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.878891] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.879208] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: cec962ae-30f3-44ea-ba7d-b2407a7f034b is going to be created. [ 711.903855] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.903855] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.903855] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.903855] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.903855] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.903855] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-cec962ae-30f3-44ea-ba7d-b2407a7f034b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.816665] env[69559]: INFO networking_nsxv3.common.synchronization [req-5e19d226-305d-4981-a2f9-c1a1903c8c19 req-0822a9bb-e111-4f46-b474-cf3926684f58 service nova] Enqueued Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_rules [ 712.816899] env[69559]: INFO networking_nsxv3.common.synchronization [req-5e19d226-305d-4981-a2f9-c1a1903c8c19 req-0822a9bb-e111-4f46-b474-cf3926684f58 service nova] Enqueued Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 712.816931] env[69559]: INFO networking_nsxv3.common.synchronization [req-5e19d226-305d-4981-a2f9-c1a1903c8c19 req-0822a9bb-e111-4f46-b474-cf3926684f58 service nova] Enqueued Resource ID: cec962ae-30f3-44ea-ba7d-b2407a7f034b with Priority: HIGHEST for action port [ 712.817187] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_rules [ 712.817339] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 712.817418] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec962ae-30f3-44ea-ba7d-b2407a7f034b with Priority: HIGHEST for action port [ 712.817991] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.820540] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.820540] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.820614] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.820693] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.821631] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.821753] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.821851] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.822054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.822204] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.826030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.826030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.826030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.826030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.826030] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.826030] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-cec962ae-30f3-44ea-ba7d-b2407a7f034b taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.826030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cec962ae-30f3-44ea-ba7d-b2407a7f034b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.826030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cec962ae-30f3-44ea-ba7d-b2407a7f034b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.826030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cec962ae-30f3-44ea-ba7d-b2407a7f034b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.826030] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cec962ae-30f3-44ea-ba7d-b2407a7f034b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.328675] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.328907] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.328977] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.329928] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cec962ae-30f3-44ea-ba7d-b2407a7f034b with status ACTIVE [ 713.330125] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.330245] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.330311] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.330521] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.330612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.330779] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.330877] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.330970] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.331096] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.331178] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.331362] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.331685] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.331685] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.331685] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.331858] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.331858] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cec962ae-30f3-44ea-ba7d-b2407a7f034b is going to be updated. [ 713.355170] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.355385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.355385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.355606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.355810] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.355908] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cec962ae-30f3-44ea-ba7d-b2407a7f034b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.725000] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-496 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.725220] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-496" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.725348] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-496" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.725697] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-496" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.725965] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.727695] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.727772] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.728749] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.728749] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.728749] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.728932] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.729101] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.729300] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.729499] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.729692] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.729918] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.750128] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.750252] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 713.750364] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.750740] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-496" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.750929] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-88373498-327e-4ed8-9d6e-0b9a3a01f3a0 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.751263] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-88373498-327e-4ed8-9d6e-0b9a3a01f3a0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.751263] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-88373498-327e-4ed8-9d6e-0b9a3a01f3a0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.751597] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-88373498-327e-4ed8-9d6e-0b9a3a01f3a0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.751815] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88373498-327e-4ed8-9d6e-0b9a3a01f3a0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.834888] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.198507] env[69559]: INFO networking_nsxv3.common.synchronization [None req-ab597315-c81b-49ad-a385-7291f31cac3d None None] Enqueued Resource ID: 09fdc851-743b-4cb7-afa3-a6953d4ac1de with Priority: HIGHEST for action port [ 714.198507] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09fdc851-743b-4cb7-afa3-a6953d4ac1de with Priority: HIGHEST for action port [ 714.198507] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-09fdc851-743b-4cb7-afa3-a6953d4ac1de taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.198507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09fdc851-743b-4cb7-afa3-a6953d4ac1de" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.198507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09fdc851-743b-4cb7-afa3-a6953d4ac1de" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.198507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09fdc851-743b-4cb7-afa3-a6953d4ac1de" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.198875] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09fdc851-743b-4cb7-afa3-a6953d4ac1de',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.254312] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.254564] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.254721] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.255085] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.255273] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.255468] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 88373498-327e-4ed8-9d6e-0b9a3a01f3a0 not found, creating... [ 714.255796] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.256045] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.256184] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.256483] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.256665] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.256991] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.258087] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.258087] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.258087] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.258264] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.258475] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 88373498-327e-4ed8-9d6e-0b9a3a01f3a0 is going to be created. [ 714.278678] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.278790] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.278907] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.282028] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.282028] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.282028] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-88373498-327e-4ed8-9d6e-0b9a3a01f3a0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.340533] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.340718] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.340991] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.340991] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.341352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.341352] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e is going to be created. [ 714.369215] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.370198] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.370298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.370573] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.370786] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.384308] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: UNINITIALIZED for 2s [ 714.609603] env[69559]: INFO networking_nsxv3.common.synchronization [req-0da3606c-c9f9-4dcb-bad6-a6be681968f3 req-cbe9757e-8ff6-44ce-8e08-ae94a3abe783 tempest-ImagesTestJSON-1150485476 tempest-ImagesTestJSON-1150485476-project-member] Enqueued Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 714.610346] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 714.611181] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.611435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.612022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.612022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.612022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.612161] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.612730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.612730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.612730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.612730] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.701175] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 09fdc851-743b-4cb7-afa3-a6953d4ac1de [ 714.701175] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.701175] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.701409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.701409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.701524] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.701767] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:09fdc851-743b-4cb7-afa3-a6953d4ac1de already deleted. [ 714.701881] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09fdc851-743b-4cb7-afa3-a6953d4ac1de" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.118610] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.118916] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.118916] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.118916] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.122783] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.122783] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.122783] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.122783] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.122783] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.122783] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.122783] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 already deleted. [ 715.122783] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.333205] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-190 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.333416] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-190" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.333543] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-190" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.333860] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-190" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.344821] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.344821] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.344821] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.344821] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.344821] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.344821] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.344821] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.344821] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.344821] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.344821] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.344821] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.344821] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.364351] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.364660] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 715.364863] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.365069] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-190" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.365410] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-d8c36156-d6d6-4c16-8edc-94c576f08fe7 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.365625] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-d8c36156-d6d6-4c16-8edc-94c576f08fe7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.365755] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-d8c36156-d6d6-4c16-8edc-94c576f08fe7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.366109] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-d8c36156-d6d6-4c16-8edc-94c576f08fe7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.366255] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8c36156-d6d6-4c16-8edc-94c576f08fe7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.399750] env[69559]: INFO networking_nsxv3.common.synchronization [req-5e19d226-305d-4981-a2f9-c1a1903c8c19 req-3116e405-2bf7-4864-aef0-6f50f259c3eb service nova] Enqueued Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_rules [ 715.401020] env[69559]: INFO networking_nsxv3.common.synchronization [req-5e19d226-305d-4981-a2f9-c1a1903c8c19 req-3116e405-2bf7-4864-aef0-6f50f259c3eb service nova] Enqueued Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 715.401020] env[69559]: INFO networking_nsxv3.common.synchronization [req-5e19d226-305d-4981-a2f9-c1a1903c8c19 req-3116e405-2bf7-4864-aef0-6f50f259c3eb service nova] Enqueued Resource ID: 88373498-327e-4ed8-9d6e-0b9a3a01f3a0 with Priority: HIGHEST for action port [ 715.401020] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_rules [ 715.401020] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 715.401020] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88373498-327e-4ed8-9d6e-0b9a3a01f3a0 with Priority: HIGHEST for action port [ 715.402082] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.402082] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.402308] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.402403] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.405687] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-88373498-327e-4ed8-9d6e-0b9a3a01f3a0 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.405687] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88373498-327e-4ed8-9d6e-0b9a3a01f3a0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.405687] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88373498-327e-4ed8-9d6e-0b9a3a01f3a0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.405687] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88373498-327e-4ed8-9d6e-0b9a3a01f3a0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.405687] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88373498-327e-4ed8-9d6e-0b9a3a01f3a0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.874399] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.874399] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.874399] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.874399] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.874399] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.874399] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port d8c36156-d6d6-4c16-8edc-94c576f08fe7 not found, creating... [ 715.875034] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.875971] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.876732] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.877486] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.877738] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.878811] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.879179] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.882033] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.882033] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.882033] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.882033] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: d8c36156-d6d6-4c16-8edc-94c576f08fe7 is going to be created. [ 715.904663] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.905099] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.905328] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.905665] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.906273] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.906694] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-d8c36156-d6d6-4c16-8edc-94c576f08fe7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.908288] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88373498-327e-4ed8-9d6e-0b9a3a01f3a0 with status ACTIVE [ 715.908628] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.908903] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.909071] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.909679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.909778] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.909961] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.910077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.910142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.910298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.910377] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.910555] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.910651] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.910712] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.910850] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.910923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.911013] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88373498-327e-4ed8-9d6e-0b9a3a01f3a0 is going to be updated. [ 715.939429] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.939610] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.939681] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.939979] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.940200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.940446] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88373498-327e-4ed8-9d6e-0b9a3a01f3a0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.327596] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-373 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.328596] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-373" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.328596] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-373" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.328596] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-373" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.328596] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.328976] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.328976] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.328976] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.332508] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.335941] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 716.335941] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 716.335941] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 716.335941] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 716.335941] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 716.335941] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 716.335941] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 716.350667] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 716.351458] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 716.351458] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 716.351458] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-373" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.351630] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-94c0ca61-9df9-4ce4-80b8-a8966cade60a taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.351833] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-94c0ca61-9df9-4ce4-80b8-a8966cade60a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.351951] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-94c0ca61-9df9-4ce4-80b8-a8966cade60a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.352324] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-94c0ca61-9df9-4ce4-80b8-a8966cade60a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.352459] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94c0ca61-9df9-4ce4-80b8-a8966cade60a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.392984] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: SUCCESS [ 716.393234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.393457] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.394439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.394439] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.394439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.394439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.394439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.394439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.394439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.395219] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.400252] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.400466] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.400649] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.400762] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.400823] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.401059] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.401208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.401310] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.452180] env[69559]: INFO networking_nsxv3.common.synchronization [None req-2769c1b5-203d-496d-8f79-eeb3e006d5bb None None] Enqueued Resource ID: f09a7f1a-b35e-4523-9354-8239448eb2f0 with Priority: HIGHEST for action port [ 716.452440] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f09a7f1a-b35e-4523-9354-8239448eb2f0 with Priority: HIGHEST for action port [ 716.454020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-f09a7f1a-b35e-4523-9354-8239448eb2f0 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.454020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f09a7f1a-b35e-4523-9354-8239448eb2f0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.454020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f09a7f1a-b35e-4523-9354-8239448eb2f0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.454020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f09a7f1a-b35e-4523-9354-8239448eb2f0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.454020] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f09a7f1a-b35e-4523-9354-8239448eb2f0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.859297] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.859687] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.859826] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.860643] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.860643] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.860643] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 94c0ca61-9df9-4ce4-80b8-a8966cade60a not found, creating... [ 716.861017] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.862070] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.862205] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.862452] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.862600] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.862918] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.863093] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.863247] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.863484] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.863630] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.863779] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 94c0ca61-9df9-4ce4-80b8-a8966cade60a is going to be created. [ 716.883891] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.884630] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.884630] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.884630] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.884763] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.884924] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-94c0ca61-9df9-4ce4-80b8-a8966cade60a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.905757] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.905906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.908490] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.944041] env[69559]: INFO networking_nsxv3.common.synchronization [None req-54e91a25-2892-489c-8f1e-83eeceff8cb9 None None] Enqueued Resource ID: 81e44061-0642-420f-b84e-9172209a39f5 with Priority: HIGHEST for action port [ 716.944041] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81e44061-0642-420f-b84e-9172209a39f5 with Priority: HIGHEST for action port [ 716.944616] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-81e44061-0642-420f-b84e-9172209a39f5 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.944762] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81e44061-0642-420f-b84e-9172209a39f5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.944811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81e44061-0642-420f-b84e-9172209a39f5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.945038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81e44061-0642-420f-b84e-9172209a39f5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.945114] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81e44061-0642-420f-b84e-9172209a39f5',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.956483] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f09a7f1a-b35e-4523-9354-8239448eb2f0 [ 716.956648] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.956891] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.956891] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.957060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.957174] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.957241] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f09a7f1a-b35e-4523-9354-8239448eb2f0 already deleted. [ 716.957322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f09a7f1a-b35e-4523-9354-8239448eb2f0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.095272] env[69559]: INFO networking_nsxv3.common.synchronization [req-0da3606c-c9f9-4dcb-bad6-a6be681968f3 req-6dc77698-b9f3-4b64-8c91-8dec1b5eeb03 service nova] Enqueued Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_rules [ 717.095785] env[69559]: INFO networking_nsxv3.common.synchronization [req-0da3606c-c9f9-4dcb-bad6-a6be681968f3 req-6dc77698-b9f3-4b64-8c91-8dec1b5eeb03 service nova] Enqueued Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 717.095785] env[69559]: INFO networking_nsxv3.common.synchronization [req-0da3606c-c9f9-4dcb-bad6-a6be681968f3 req-6dc77698-b9f3-4b64-8c91-8dec1b5eeb03 service nova] Enqueued Resource ID: d8c36156-d6d6-4c16-8edc-94c576f08fe7 with Priority: HIGHEST for action port [ 717.096145] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_rules [ 717.096252] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 717.096340] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8c36156-d6d6-4c16-8edc-94c576f08fe7 with Priority: HIGHEST for action port [ 717.096846] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.096977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.098556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.098556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.098556] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.101838] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.101838] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.101838] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.102071] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.102099] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.102404] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.102404] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.102404] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.102502] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.102561] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.108254] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8c36156-d6d6-4c16-8edc-94c576f08fe7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.108452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8c36156-d6d6-4c16-8edc-94c576f08fe7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.108452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8c36156-d6d6-4c16-8edc-94c576f08fe7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.108631] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8c36156-d6d6-4c16-8edc-94c576f08fe7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.108711] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8c36156-d6d6-4c16-8edc-94c576f08fe7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.238020] env[69559]: INFO networking_nsxv3.common.synchronization [req-4cb70d39-e211-4905-bbda-faea6d909903 req-158ecf46-514e-43a2-995e-b2b6ff8a4a85 tempest-DeleteServersTestJSON-1423597435 tempest-DeleteServersTestJSON-1423597435-project-member] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 717.238020] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 717.238020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.238020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.238020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.238020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.238020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.238020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.238020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.239097] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.239316] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.239552] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.412172] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.448457] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81e44061-0642-420f-b84e-9172209a39f5 [ 717.448457] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.448457] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.448457] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.448457] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.448457] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.448457] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81e44061-0642-420f-b84e-9172209a39f5 already deleted. [ 717.448457] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81e44061-0642-420f-b84e-9172209a39f5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.544966] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-596 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.545216] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.545335] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.545678] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.545942] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.547061] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.547402] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.547596] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.548225] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.549134] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.549220] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.549329] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.552214] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.552356] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.552469] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.552613] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.571533] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.571706] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 717.571839] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.572030] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.572362] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-a953e003-020b-48e1-8700-a97feb62a964 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.572577] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-a953e003-020b-48e1-8700-a97feb62a964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.572640] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-a953e003-020b-48e1-8700-a97feb62a964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.572971] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-a953e003-020b-48e1-8700-a97feb62a964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.573126] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a953e003-020b-48e1-8700-a97feb62a964',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.604487] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.604625] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.613412] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.614471] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8c36156-d6d6-4c16-8edc-94c576f08fe7 with status ACTIVE [ 717.614682] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.614937] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.614937] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.615101] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.615190] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.615945] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.615945] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.615945] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.615945] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.615945] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.615945] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.616395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.616395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.616395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.616395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.616395] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8c36156-d6d6-4c16-8edc-94c576f08fe7 is going to be updated. [ 717.637309] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.637309] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.637309] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.637309] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.637309] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.637597] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8c36156-d6d6-4c16-8edc-94c576f08fe7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.745026] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.745026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.745026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.745026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.745026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.745026] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.745026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.745026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.745026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.745026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.745026] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d already deleted. [ 717.745026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.864966] env[69559]: INFO networking_nsxv3.common.synchronization [req-5e19d226-305d-4981-a2f9-c1a1903c8c19 req-8d256246-3421-4b37-a904-57af6c24dd7c service nova] Enqueued Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_rules [ 717.865180] env[69559]: INFO networking_nsxv3.common.synchronization [req-5e19d226-305d-4981-a2f9-c1a1903c8c19 req-8d256246-3421-4b37-a904-57af6c24dd7c service nova] Enqueued Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 717.865349] env[69559]: INFO networking_nsxv3.common.synchronization [req-5e19d226-305d-4981-a2f9-c1a1903c8c19 req-8d256246-3421-4b37-a904-57af6c24dd7c service nova] Enqueued Resource ID: 94c0ca61-9df9-4ce4-80b8-a8966cade60a with Priority: HIGHEST for action port [ 717.865599] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_rules [ 717.865724] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 717.865817] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94c0ca61-9df9-4ce4-80b8-a8966cade60a with Priority: HIGHEST for action port [ 717.866394] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.866499] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.866695] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.866778] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.866949] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-94c0ca61-9df9-4ce4-80b8-a8966cade60a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.867516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94c0ca61-9df9-4ce4-80b8-a8966cade60a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.867582] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94c0ca61-9df9-4ce4-80b8-a8966cade60a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.867764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94c0ca61-9df9-4ce4-80b8-a8966cade60a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.871419] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94c0ca61-9df9-4ce4-80b8-a8966cade60a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.918427] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.918513] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.918668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.918800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.918891] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.918996] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e is going to be updated. [ 717.945654] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.945797] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.945866] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.946100] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.946259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.953975] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: IN_PROGRESS for 2s [ 718.078151] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.078401] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.078529] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.078823] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.078979] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.079153] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port a953e003-020b-48e1-8700-a97feb62a964 not found, creating... [ 718.079441] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.079602] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.079725] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.079950] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.080102] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.080388] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.080545] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.080663] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.081793] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.082243] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.082450] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: a953e003-020b-48e1-8700-a97feb62a964 is going to be created. [ 718.103318] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.103543] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.103668] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.103948] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.104182] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.104422] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-a953e003-020b-48e1-8700-a97feb62a964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.119984] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.381183] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94c0ca61-9df9-4ce4-80b8-a8966cade60a with status ACTIVE [ 718.381183] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.381183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.381183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.381183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.381183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.381183] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.381183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.381183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.381183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.381183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.381183] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.381183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.381183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.381183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.381183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.381183] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94c0ca61-9df9-4ce4-80b8-a8966cade60a is going to be updated. [ 718.404061] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.404061] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.404061] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.404061] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.404061] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.405844] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94c0ca61-9df9-4ce4-80b8-a8966cade60a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.621302] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.622496] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.624832] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.624832] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.624832] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.624832] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 is going to be created. [ 718.649751] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.649751] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.649751] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.649751] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.649751] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.660417] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: UNINITIALIZED for 2s [ 718.862237] env[69559]: INFO networking_nsxv3.common.synchronization [req-4cb70d39-e211-4905-bbda-faea6d909903 req-6c4c8e0a-be73-42ea-9936-1d56dee2db48 service nova] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_rules [ 718.862278] env[69559]: INFO networking_nsxv3.common.synchronization [req-4cb70d39-e211-4905-bbda-faea6d909903 req-6c4c8e0a-be73-42ea-9936-1d56dee2db48 service nova] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 718.862431] env[69559]: INFO networking_nsxv3.common.synchronization [req-4cb70d39-e211-4905-bbda-faea6d909903 req-6c4c8e0a-be73-42ea-9936-1d56dee2db48 service nova] Enqueued Resource ID: a953e003-020b-48e1-8700-a97feb62a964 with Priority: HIGHEST for action port [ 718.863150] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_rules [ 718.863150] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 718.863150] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a953e003-020b-48e1-8700-a97feb62a964 with Priority: HIGHEST for action port [ 718.863534] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.863534] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.863713] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.863849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.863967] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.865391] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.865391] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.865605] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.865647] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.865794] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.865852] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.865919] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.866060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.866152] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.866245] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.867035] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-a953e003-020b-48e1-8700-a97feb62a964 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.867146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a953e003-020b-48e1-8700-a97feb62a964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.867215] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a953e003-020b-48e1-8700-a97feb62a964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.867371] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a953e003-020b-48e1-8700-a97feb62a964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.867469] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a953e003-020b-48e1-8700-a97feb62a964',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.371106] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.371106] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.371106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.371327] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a953e003-020b-48e1-8700-a97feb62a964 with status ACTIVE [ 719.371463] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.371593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.371684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.371969] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.372121] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.372331] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.372435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.372524] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.372724] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.372811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.373020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.373147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.373219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.373441] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.373518] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.373644] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a953e003-020b-48e1-8700-a97feb62a964 is going to be updated. [ 719.397031] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.397216] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.397273] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.397571] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.397717] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.397885] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a953e003-020b-48e1-8700-a97feb62a964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.443474] env[69559]: INFO networking_nsxv3.common.synchronization [None req-a18517dd-2935-4f7a-9410-fb5d3ba14cf5 None None] Enqueued Resource ID: a9f192f1-35ad-42d4-a3f1-41d23558eea9 with Priority: HIGHEST for action port [ 719.444652] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9f192f1-35ad-42d4-a3f1-41d23558eea9 with Priority: HIGHEST for action port [ 719.445642] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9f192f1-35ad-42d4-a3f1-41d23558eea9 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.445811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9f192f1-35ad-42d4-a3f1-41d23558eea9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.445870] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9f192f1-35ad-42d4-a3f1-41d23558eea9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.446137] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9f192f1-35ad-42d4-a3f1-41d23558eea9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.446253] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9f192f1-35ad-42d4-a3f1-41d23558eea9',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.875898] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.948889] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9f192f1-35ad-42d4-a3f1-41d23558eea9 [ 719.949177] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.949346] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.949519] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.949664] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.949777] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.949878] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9f192f1-35ad-42d4-a3f1-41d23558eea9 already deleted. [ 719.949978] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9f192f1-35ad-42d4-a3f1-41d23558eea9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.965036] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: SUCCESS [ 719.965036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.965036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.965036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.965036] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.965036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.965036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.965036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.965036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.965036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.965036] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.965036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.965036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.965036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.965901] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.965901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.965901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.965901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.965901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.965901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.965901] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.969057] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.973022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.973022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.973022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.973022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.973022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.973022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.973022] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.378402] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.378802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.378886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.379151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.379235] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.379342] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be created. [ 720.402311] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.402501] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.402599] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.402879] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.403080] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.411712] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: UNINITIALIZED for 2s [ 720.477621] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbe866c5-e7b8-4862-b37c-6b17f875f07e: rpc.has_security_group_logging(os_id): False [ 720.477621] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.495027] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.495027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.495027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.495027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.495027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.495027] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.495027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.495027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.495027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.495027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.495027] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.495027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.495027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.495027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.495027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.495565] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.495565] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.495565] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.495565] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.495565] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.495565] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e is going to be created. [ 720.553105] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.553307] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.553307] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.553565] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.553758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.564379] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: IN_PROGRESS for 2s [ 720.671674] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: SUCCESS [ 720.671902] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.672074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.672303] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.672497] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.672617] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.672673] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.672821] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.672900] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.672986] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.673099] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.958262] env[69559]: INFO networking_nsxv3.common.synchronization [req-9a1233d3-77cc-4345-b4d5-cd3ef7253310 req-373597b0-7215-4a03-b25c-82008dc1b686 tempest-ServerAddressesTestJSON-1295953973 tempest-ServerAddressesTestJSON-1295953973-project-member] Enqueued Resource ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 with Priority: HIGHEST for action security_group_members [ 720.958837] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 with Priority: HIGHEST for action security_group_members [ 720.960017] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-039c805f-b0b4-4b54-b42e-9f95c1e21442 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.960157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.960219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.960553] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.960707] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.960790] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.960891] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.961457] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.961548] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.961665] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('039c805f-b0b4-4b54-b42e-9f95c1e21442',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.977413] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.177927] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.178092] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.178183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.178402] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.178624] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.178750] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.178794] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.179107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.179198] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.179293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.179474] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.179575] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.179629] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.179768] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.179908] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.180044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.180107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.180250] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.180328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.180421] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.180534] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.463359] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.463521] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.463692] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.463949] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.464062] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.464318] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.464427] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.464493] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.464673] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.464750] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.464836] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 already deleted. [ 721.464918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.482753] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.482962] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.483067] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.483308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.483408] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.483573] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e is going to be updated. [ 721.510239] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.510402] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.510480] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.510695] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.510834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.520195] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: IN_PROGRESS for 2s [ 721.528824] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-579 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.529673] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-579" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.529673] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-579" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.529673] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-579" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.529801] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.529915] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.530515] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.531064] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.531064] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.532028] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 721.532028] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.532028] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.532028] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.532028] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 721.532028] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.532302] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.547999] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.548200] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.016 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 721.548344] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.548553] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-579" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.548863] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-7b278f2c-6057-496d-906b-ccdf2e6456ed taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.549055] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-7b278f2c-6057-496d-906b-ccdf2e6456ed" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.549202] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-7b278f2c-6057-496d-906b-ccdf2e6456ed" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.549526] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-7b278f2c-6057-496d-906b-ccdf2e6456ed" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.549669] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b278f2c-6057-496d-906b-ccdf2e6456ed',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.683404] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55a5191b-a436-4df6-a235-6b2c46e6eea7: rpc.has_security_group_logging(os_id): False [ 721.701729] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.701928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.702105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.702366] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.702556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.702899] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.703060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.703303] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.704921] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.704921] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.704921] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.704921] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.704921] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.704921] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.704921] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.704921] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.704921] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.704921] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.705707] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.705707] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.705707] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 is going to be created. [ 721.759450] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.759625] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.759721] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.759955] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.760193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.771128] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: IN_PROGRESS for 2s [ 722.053746] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.054135] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.054253] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.054495] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.054659] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.054904] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 7b278f2c-6057-496d-906b-ccdf2e6456ed not found, creating... [ 722.055188] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.055915] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.055915] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.055915] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.055915] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.056128] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.056287] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.056404] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.056646] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.056786] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.056928] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 7b278f2c-6057-496d-906b-ccdf2e6456ed is going to be created. [ 722.079476] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.079771] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.079954] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.080328] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.080620] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.080933] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-7b278f2c-6057-496d-906b-ccdf2e6456ed" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.421386] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 722.421613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.421780] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.421998] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.422245] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.422392] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.422467] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.422605] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.422688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.422777] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.422867] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.578097] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: SUCCESS [ 722.578097] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.578097] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.578097] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.578097] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.928024] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.928024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.928024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.928024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.928024] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.928024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.928024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.928024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.928024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.928024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.928024] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.928024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.928024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.928024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.928024] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.928024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.928742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.928742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.928742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.928742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.928742] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.080906] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.081274] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.246330] env[69559]: INFO networking_nsxv3.common.synchronization [req-9a1233d3-77cc-4345-b4d5-cd3ef7253310 req-a716c856-d89f-4357-b948-a5a53be18afe service nova] Enqueued Resource ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 with Priority: HIGHEST for action security_group_rules [ 723.246522] env[69559]: INFO networking_nsxv3.common.synchronization [req-9a1233d3-77cc-4345-b4d5-cd3ef7253310 req-a716c856-d89f-4357-b948-a5a53be18afe service nova] Enqueued Resource ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 with Priority: HIGHEST for action security_group_members [ 723.246687] env[69559]: INFO networking_nsxv3.common.synchronization [req-9a1233d3-77cc-4345-b4d5-cd3ef7253310 req-a716c856-d89f-4357-b948-a5a53be18afe service nova] Enqueued Resource ID: 7b278f2c-6057-496d-906b-ccdf2e6456ed with Priority: HIGHEST for action port [ 723.249018] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 with Priority: HIGHEST for action security_group_rules [ 723.249218] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 with Priority: HIGHEST for action security_group_members [ 723.249353] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b278f2c-6057-496d-906b-ccdf2e6456ed with Priority: HIGHEST for action port [ 723.249715] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-039c805f-b0b4-4b54-b42e-9f95c1e21442 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.249915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.250026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.250352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.250446] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('039c805f-b0b4-4b54-b42e-9f95c1e21442',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.251464] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-039c805f-b0b4-4b54-b42e-9f95c1e21442 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.251622] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.251713] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.252281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.252281] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.252281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.252281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.252540] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.252657] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.252792] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('039c805f-b0b4-4b54-b42e-9f95c1e21442',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.253712] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b278f2c-6057-496d-906b-ccdf2e6456ed taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.253971] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b278f2c-6057-496d-906b-ccdf2e6456ed" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.254081] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b278f2c-6057-496d-906b-ccdf2e6456ed" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.255255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b278f2c-6057-496d-906b-ccdf2e6456ed" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.255255] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b278f2c-6057-496d-906b-ccdf2e6456ed',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.434478] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 839ae40b-5f13-4259-8e2a-b943b206557d: rpc.has_security_group_logging(os_id): False [ 723.455067] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.455233] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.455306] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.456140] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.456262] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.456501] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.456615] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.457460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.457460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.457460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.457460] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.457460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.457460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.457460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.457460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.457757] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.457757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.457843] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.457966] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.458059] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.458145] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be created. [ 723.516381] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.516381] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.516381] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.516381] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.516381] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.528929] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: SUCCESS [ 723.529186] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.529368] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.529653] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.529814] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.529933] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.532017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.532017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.532017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.532017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.532017] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.532353] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 723.756487] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-039c805f-b0b4-4b54-b42e-9f95c1e21442 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.756689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.757089] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('039c805f-b0b4-4b54-b42e-9f95c1e21442',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.758385] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b278f2c-6057-496d-906b-ccdf2e6456ed with status ACTIVE [ 723.758704] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.758886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.758989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.759314] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.759462] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.759935] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.759935] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.760063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.760611] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.760611] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.761017] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.761122] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.761202] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.761497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.761614] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.761757] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b278f2c-6057-496d-906b-ccdf2e6456ed is going to be updated. [ 723.783253] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: SUCCESS [ 723.783567] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.791855] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.792084] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.792504] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.792788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.792788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.792999] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b278f2c-6057-496d-906b-ccdf2e6456ed" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.022108] env[69559]: INFO networking_nsxv3.common.synchronization [req-914f387f-f6f4-4ab2-b6b7-0c3e52b72dcd req-385eedd4-1ac4-4467-b7a2-41fe9563d7a3 tempest-ServerActionsV293TestJSON-791060682 tempest-ServerActionsV293TestJSON-791060682-project-member] Enqueued Resource ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf with Priority: HIGHEST for action security_group_members [ 724.023145] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf with Priority: HIGHEST for action security_group_members [ 724.023669] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bd39e16-65ec-4813-afc3-35754d24a5bf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.023999] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.024248] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.025604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.025604] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.025604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.025604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.025604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.025604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.025604] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9bd39e16-65ec-4813-afc3-35754d24a5bf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.037295] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.037295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.037295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.037295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.037295] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.037295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.037295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.037295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.037295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.037295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.037295] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.037295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.037295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.037295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.037295] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.037295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.037757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.037757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.037757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.037757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.037757] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.265560] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('039c805f-b0b4-4b54-b42e-9f95c1e21442',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.530486] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.530486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.530486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.530486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.530486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.530486] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.530486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.530486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.530486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.530486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.530486] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf already deleted. [ 724.530486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.543128] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbe866c5-e7b8-4862-b37c-6b17f875f07e: rpc.has_security_group_logging(os_id): False [ 724.560689] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.561208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.563021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.563021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.563021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.563021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.563021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.563021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.563021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.563021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.563021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.566613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.566613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.566613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.566613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.566613] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.566613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.566613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.566613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.566613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.566613] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e is going to be updated. [ 724.622276] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.622276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.622276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.622276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.622276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.631613] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: IN_PROGRESS for 2s [ 724.770953] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.771344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.771475] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.771741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.771883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.772048] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 is going to be created. [ 724.794048] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.794271] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.794271] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.794478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.794674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.803930] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 in Status: UNINITIALIZED for 2s [ 724.843967] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-60 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.844257] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-60" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.844429] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-60" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.844827] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-60" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.845881] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.845881] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.845881] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.845881] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.846151] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.846400] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 724.846549] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 724.846669] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 724.846781] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 724.846925] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 724.848670] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 724.848670] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 724.866176] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 724.866371] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 724.866515] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 724.866684] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-60" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.867008] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-dfa0eef8-02a2-46e2-9f8d-de45dc5a7bdd taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.867197] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-dfa0eef8-02a2-46e2-9f8d-de45dc5a7bdd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.867318] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-dfa0eef8-02a2-46e2-9f8d-de45dc5a7bdd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.867773] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-dfa0eef8-02a2-46e2-9f8d-de45dc5a7bdd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.867913] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfa0eef8-02a2-46e2-9f8d-de45dc5a7bdd',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.371246] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.371552] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.371636] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.372016] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.372365] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.372573] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port dfa0eef8-02a2-46e2-9f8d-de45dc5a7bdd not found, creating... [ 725.372906] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.373112] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.373239] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.373475] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.373619] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.373906] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.374078] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.374199] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.374476] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.374640] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.374786] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: dfa0eef8-02a2-46e2-9f8d-de45dc5a7bdd is going to be created. [ 725.396864] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.397140] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.397298] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.397619] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.397837] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.398078] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-dfa0eef8-02a2-46e2-9f8d-de45dc5a7bdd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.549299] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 725.552248] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.481169] env[69559]: INFO networking_nsxv3.common.synchronization [req-914f387f-f6f4-4ab2-b6b7-0c3e52b72dcd req-d077ae3c-9c86-42d1-bac4-720d293c0c27 service nova] Enqueued Resource ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf with Priority: HIGHEST for action security_group_rules [ 726.481496] env[69559]: INFO networking_nsxv3.common.synchronization [req-914f387f-f6f4-4ab2-b6b7-0c3e52b72dcd req-d077ae3c-9c86-42d1-bac4-720d293c0c27 service nova] Enqueued Resource ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf with Priority: HIGHEST for action security_group_members [ 726.481627] env[69559]: INFO networking_nsxv3.common.synchronization [req-914f387f-f6f4-4ab2-b6b7-0c3e52b72dcd req-d077ae3c-9c86-42d1-bac4-720d293c0c27 service nova] Enqueued Resource ID: dfa0eef8-02a2-46e2-9f8d-de45dc5a7bdd with Priority: HIGHEST for action port [ 726.482185] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf with Priority: HIGHEST for action security_group_rules [ 726.482327] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf with Priority: HIGHEST for action security_group_members [ 726.482427] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfa0eef8-02a2-46e2-9f8d-de45dc5a7bdd with Priority: HIGHEST for action port [ 726.482713] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9bd39e16-65ec-4813-afc3-35754d24a5bf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.482843] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.482922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.483204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.483296] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9bd39e16-65ec-4813-afc3-35754d24a5bf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.484223] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bd39e16-65ec-4813-afc3-35754d24a5bf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.485456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.485456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.485456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.485456] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.485456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.485456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.485456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.485456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.485456] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9bd39e16-65ec-4813-afc3-35754d24a5bf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.486578] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfa0eef8-02a2-46e2-9f8d-de45dc5a7bdd taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.486723] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfa0eef8-02a2-46e2-9f8d-de45dc5a7bdd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.486798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfa0eef8-02a2-46e2-9f8d-de45dc5a7bdd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.487009] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfa0eef8-02a2-46e2-9f8d-de45dc5a7bdd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.487094] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfa0eef8-02a2-46e2-9f8d-de45dc5a7bdd',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.649025] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: SUCCESS [ 726.649025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.649025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.649025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.649025] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.813893] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 in Status: SUCCESS [ 726.814258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.815164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.815164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.815164] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.815655] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.815655] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.815879] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.815990] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.816137] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.816244] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('039c805f-b0b4-4b54-b42e-9f95c1e21442',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.990276] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bd39e16-65ec-4813-afc3-35754d24a5bf taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.990276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.990276] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9bd39e16-65ec-4813-afc3-35754d24a5bf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.990276] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dfa0eef8-02a2-46e2-9f8d-de45dc5a7bdd with status ACTIVE [ 726.991451] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.991621] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.991723] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.992040] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.994026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.994026] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.994026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.994026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.994026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.994026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.994391] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.994528] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.994623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.994817] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.996016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.996136] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dfa0eef8-02a2-46e2-9f8d-de45dc5a7bdd is going to be updated. [ 727.015657] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.015921] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.016027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.016327] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.016510] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.016719] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfa0eef8-02a2-46e2-9f8d-de45dc5a7bdd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.153507] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.154120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.154120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.154120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.154120] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.154339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.154339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.154425] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.154516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.154601] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.154692] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.320851] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-039c805f-b0b4-4b54-b42e-9f95c1e21442 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.321023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.321133] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.321584] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.321774] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.321882] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.321946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.322108] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.322198] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.322284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.322427] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-039c805f-b0b4-4b54-b42e-9f95c1e21442 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.322520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.322581] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.322784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.323146] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.323146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.323252] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.323311] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.323385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.323466] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.323557] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('039c805f-b0b4-4b54-b42e-9f95c1e21442',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.498734] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9bd39e16-65ec-4813-afc3-35754d24a5bf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.658728] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.658931] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.659166] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.659317] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.659504] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.659604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.659663] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.660337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.660337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.660337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.660337] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.660337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.660337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.660646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.660739] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.660962] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.660962] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.661124] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.661173] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.661268] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.661363] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.826438] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 039c805f-b0b4-4b54-b42e-9f95c1e21442: rpc.has_security_group_logging(os_id): False [ 727.845474] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.845474] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.845474] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.845880] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.846101] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.846187] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.846272] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.846375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.846500] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.846608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.846883] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.847000] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.847610] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.847760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.848227] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.848227] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.848424] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.848457] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.848754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.848754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.848846] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 is going to be created. [ 727.931700] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.931700] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.931700] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.931700] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.932121] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.953415] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 in Status: IN_PROGRESS for 2s [ 728.001075] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.001520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.001600] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.001825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.001917] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.002024] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf is going to be created. [ 728.025642] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.028019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.028019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.028019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.028019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.043276] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf in Status: UNINITIALIZED for 2s [ 728.166964] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbe866c5-e7b8-4862-b37c-6b17f875f07e: rpc.has_security_group_logging(os_id): False [ 728.188057] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.188202] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.188272] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.188489] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.188619] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.188818] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.188917] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.188981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.189145] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.189224] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.189405] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.189497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.189557] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.189691] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.189775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.191776] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.191776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.191776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.191776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.191776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.191776] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e is going to be updated. [ 728.294841] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.295025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.295076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.298768] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.298768] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.312507] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: IN_PROGRESS for 2s [ 728.623976] env[69559]: INFO networking_nsxv3.common.synchronization [None req-c976cbf2-0b2c-43c2-9827-2f28d64a3cc4 None None] Enqueued Resource ID: 06a5041d-6780-4393-9731-5e29e3108dba with Priority: HIGHEST for action port [ 728.624273] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06a5041d-6780-4393-9731-5e29e3108dba with Priority: HIGHEST for action port [ 728.624813] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-06a5041d-6780-4393-9731-5e29e3108dba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.624966] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06a5041d-6780-4393-9731-5e29e3108dba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.625048] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06a5041d-6780-4393-9731-5e29e3108dba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.625297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06a5041d-6780-4393-9731-5e29e3108dba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.625380] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06a5041d-6780-4393-9731-5e29e3108dba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.131277] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06a5041d-6780-4393-9731-5e29e3108dba [ 729.131522] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.131710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.131805] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.132094] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.132219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.132337] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06a5041d-6780-4393-9731-5e29e3108dba already deleted. [ 729.132465] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06a5041d-6780-4393-9731-5e29e3108dba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.335971] env[69559]: INFO networking_nsxv3.common.synchronization [req-3262129d-b613-4391-8e67-c14e2e651833 req-ef20ddba-a0b7-4859-830d-758f1dbc9452 tempest-DeleteServersAdminTestJSON-301366711 tempest-DeleteServersAdminTestJSON-301366711-project-member] Enqueued Resource ID: b5e555cc-4bc4-4e59-b77f-deda078818fb with Priority: HIGHEST for action security_group_members [ 729.336579] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5e555cc-4bc4-4e59-b77f-deda078818fb with Priority: HIGHEST for action security_group_members [ 729.336932] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5e555cc-4bc4-4e59-b77f-deda078818fb taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.337654] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.337654] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.337967] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.338297] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.338530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.338691] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.338969] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.339163] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.339307] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5e555cc-4bc4-4e59-b77f-deda078818fb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.842118] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.842435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.842580] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.842878] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.842983] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.843203] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.843308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.843366] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.843520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.843599] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.843685] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5e555cc-4bc4-4e59-b77f-deda078818fb is going to be updated. [ 729.874019] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.874019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.874019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.874019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.874019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.880012] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5e555cc-4bc4-4e59-b77f-deda078818fb in Status: IN_PROGRESS for 2s [ 729.955855] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.956689] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.956897] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.957237] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.957555] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.957748] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.957864] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.958146] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.958496] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.958579] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 729.958659] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 729.958804] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 729.958928] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 729.959504] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 729.959504] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 729.959504] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 729.982280] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 in Status: SUCCESS [ 729.982280] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.985630] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 729.985819] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 729.985977] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 729.986173] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.986511] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-61a655da-fc25-46b4-8e6b-56d23c469543 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.986844] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-61a655da-fc25-46b4-8e6b-56d23c469543" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.986982] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-61a655da-fc25-46b4-8e6b-56d23c469543" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.987336] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-61a655da-fc25-46b4-8e6b-56d23c469543" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.987501] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61a655da-fc25-46b4-8e6b-56d23c469543',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.053803] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf in Status: SUCCESS [ 730.054051] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.054213] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.054989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.054989] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.054989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.054989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.054989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.054989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.055276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.055276] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9bd39e16-65ec-4813-afc3-35754d24a5bf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.328745] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: SUCCESS [ 730.328968] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.491675] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.491905] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.492050] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.492346] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.492500] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.492659] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 61a655da-fc25-46b4-8e6b-56d23c469543 not found, creating... [ 730.492925] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.493101] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.493224] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.493452] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.493572] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.493882] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.494008] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.494140] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.494327] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.494460] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.494599] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 61a655da-fc25-46b4-8e6b-56d23c469543 is going to be created. [ 730.528948] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.529567] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.529567] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.529670] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.529861] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.530096] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-61a655da-fc25-46b4-8e6b-56d23c469543" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.558141] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9bd39e16-65ec-4813-afc3-35754d24a5bf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.776841] env[69559]: INFO networking_nsxv3.common.synchronization [None req-8f74025b-90fc-479a-828a-b26173ad7511 None None] Enqueued Resource ID: 70ff1751-25cd-45d8-afe6-04a6215a4292 with Priority: HIGHEST for action port [ 730.777464] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70ff1751-25cd-45d8-afe6-04a6215a4292 with Priority: HIGHEST for action port [ 730.777838] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-70ff1751-25cd-45d8-afe6-04a6215a4292 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.778541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70ff1751-25cd-45d8-afe6-04a6215a4292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.778541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70ff1751-25cd-45d8-afe6-04a6215a4292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.778541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70ff1751-25cd-45d8-afe6-04a6215a4292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.778541] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70ff1751-25cd-45d8-afe6-04a6215a4292',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.833206] env[69559]: INFO networking_nsxv3.common.synchronization [req-f0db54ee-8e10-4bb9-a316-b9cc3c7f8c0c req-8e89c209-d420-4287-b053-a20415a6bb80 tempest-DeleteServersTestJSON-1423597435 tempest-DeleteServersTestJSON-1423597435-project-member] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 730.833206] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 730.833206] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.833206] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.833206] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.833206] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.833206] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.833206] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.833206] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.833206] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.833206] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.833206] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.903349] env[69559]: INFO networking_nsxv3.common.synchronization [req-b5955684-a584-45f7-abf7-b39dd09b8a8d req-847524dd-3c1f-4fd2-9dd1-82e173b083a4 tempest-ServersTestMultiNic-1711850925 tempest-ServersTestMultiNic-1711850925-project-member] Enqueued Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 730.904566] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 730.907018] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.907018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.907018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.907018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.907018] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.907018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.907018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.907018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.907018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.907018] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.064341] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9bd39e16-65ec-4813-afc3-35754d24a5bf: rpc.has_security_group_logging(os_id): False [ 731.090547] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.092020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.092020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.092020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.092020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.092020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.092020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.092020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.092020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.092020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.092020] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf is going to be created. [ 731.095665] env[69559]: INFO networking_nsxv3.common.synchronization [req-b5955684-a584-45f7-abf7-b39dd09b8a8d req-e47445d7-6b91-414d-af8e-6fb2079a6b43 tempest-ServersTestMultiNic-1711850925 tempest-ServersTestMultiNic-1711850925-project-member] Enqueued Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 731.096441] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 731.097183] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.100379] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.178074] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.178531] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.178531] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.178531] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.178732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.198644] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf in Status: IN_PROGRESS for 2s [ 731.280890] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70ff1751-25cd-45d8-afe6-04a6215a4292 [ 731.280890] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.281134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.282508] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.282508] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.282508] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.282508] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70ff1751-25cd-45d8-afe6-04a6215a4292 already deleted. [ 731.282508] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70ff1751-25cd-45d8-afe6-04a6215a4292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.310956] env[69559]: INFO networking_nsxv3.common.synchronization [req-b5955684-a584-45f7-abf7-b39dd09b8a8d req-9f20d9aa-5973-405d-b7e9-223f40eaab13 tempest-ServersTestMultiNic-1711850925 tempest-ServersTestMultiNic-1711850925-project-member] Enqueued Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 731.312749] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 731.313383] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.316021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.336713] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.336713] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.336713] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.336713] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.336713] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.336986] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.337054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.337100] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.338056] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.338056] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.338223] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be updated. [ 731.367845] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.368047] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.368134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.368764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.368764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.380019] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 731.409223] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.466930] env[69559]: INFO networking_nsxv3.common.synchronization [req-3262129d-b613-4391-8e67-c14e2e651833 req-b8b95784-198b-4489-a453-c0fefa65a2fb service nova] Enqueued Resource ID: b5e555cc-4bc4-4e59-b77f-deda078818fb with Priority: HIGHEST for action security_group_rules [ 731.467703] env[69559]: INFO networking_nsxv3.common.synchronization [req-3262129d-b613-4391-8e67-c14e2e651833 req-b8b95784-198b-4489-a453-c0fefa65a2fb service nova] Enqueued Resource ID: b5e555cc-4bc4-4e59-b77f-deda078818fb with Priority: HIGHEST for action security_group_members [ 731.467703] env[69559]: INFO networking_nsxv3.common.synchronization [req-3262129d-b613-4391-8e67-c14e2e651833 req-b8b95784-198b-4489-a453-c0fefa65a2fb service nova] Enqueued Resource ID: 61a655da-fc25-46b4-8e6b-56d23c469543 with Priority: HIGHEST for action port [ 731.468939] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5e555cc-4bc4-4e59-b77f-deda078818fb with Priority: HIGHEST for action security_group_rules [ 731.469353] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5e555cc-4bc4-4e59-b77f-deda078818fb with Priority: HIGHEST for action security_group_members [ 731.469472] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61a655da-fc25-46b4-8e6b-56d23c469543 with Priority: HIGHEST for action port [ 731.469759] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5e555cc-4bc4-4e59-b77f-deda078818fb taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.469919] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.470032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.472327] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.472327] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5e555cc-4bc4-4e59-b77f-deda078818fb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.472807] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5e555cc-4bc4-4e59-b77f-deda078818fb taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.473629] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.473848] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-61a655da-fc25-46b4-8e6b-56d23c469543 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.474058] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61a655da-fc25-46b4-8e6b-56d23c469543" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.474058] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61a655da-fc25-46b4-8e6b-56d23c469543" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.474757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61a655da-fc25-46b4-8e6b-56d23c469543" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.474757] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61a655da-fc25-46b4-8e6b-56d23c469543',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.816632] env[69559]: INFO networking_nsxv3.common.synchronization [req-b9f3576b-805f-470d-90e1-be242d709ac1 req-c9da71be-ff6b-42e2-92bd-444aa62f669c tempest-ServersTestJSON-1384568919 tempest-ServersTestJSON-1384568919-project-member] Enqueued Resource ID: 99092389-59da-4e36-9a78-d2e1e7edec3e with Priority: HIGHEST for action security_group_members [ 731.817220] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99092389-59da-4e36-9a78-d2e1e7edec3e with Priority: HIGHEST for action security_group_members [ 731.817891] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-99092389-59da-4e36-9a78-d2e1e7edec3e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.818751] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.818751] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.818870] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.818986] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.819085] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.819145] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.819293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.819395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.820105] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99092389-59da-4e36-9a78-d2e1e7edec3e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.891062] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5e555cc-4bc4-4e59-b77f-deda078818fb in Status: SUCCESS [ 731.891401] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5e555cc-4bc4-4e59-b77f-deda078818fb deletion is rescheduled due to dependency. [ 731.891401] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.891520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.891728] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.891906] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.892036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.892095] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.892268] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.892349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.892461] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5e555cc-4bc4-4e59-b77f-deda078818fb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.916540] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.975193] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5e555cc-4bc4-4e59-b77f-deda078818fb taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.975309] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.984545] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61a655da-fc25-46b4-8e6b-56d23c469543 with status ACTIVE [ 731.984545] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.984545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.984545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.984545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.984545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.984545] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.984545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.984545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.984545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.984878] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.984878] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.984878] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.984978] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.985179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.985179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.985271] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61a655da-fc25-46b4-8e6b-56d23c469543 is going to be updated. [ 732.007326] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.007450] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.007524] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.007773] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.007915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.008118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61a655da-fc25-46b4-8e6b-56d23c469543" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.152886] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-59 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.153206] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-59" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.154732] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-59" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.154732] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-59" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.154732] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.154732] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.154732] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.154732] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.155109] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.155282] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.155473] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.155684] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.155816] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.155975] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.156260] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.156418] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.177621] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.177833] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 732.178010] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.178211] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-59" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.178535] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-6bdf0a78-b0ab-4b63-b5d7-224cfb192251 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.178714] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-6bdf0a78-b0ab-4b63-b5d7-224cfb192251" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.178837] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-6bdf0a78-b0ab-4b63-b5d7-224cfb192251" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.179186] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-6bdf0a78-b0ab-4b63-b5d7-224cfb192251" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.179325] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bdf0a78-b0ab-4b63-b5d7-224cfb192251',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.325246] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.325246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.325246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.325246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.325246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.325246] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.325246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.325246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.325246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.325246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.325246] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99092389-59da-4e36-9a78-d2e1e7edec3e already deleted. [ 732.325246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.396888] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5e555cc-4bc4-4e59-b77f-deda078818fb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.419759] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.419912] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.419986] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.420209] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.420423] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.420423] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e is going to be updated. [ 732.449020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.449183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.449254] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.449459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.449597] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.458155] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: IN_PROGRESS for 2s [ 732.681933] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.682175] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.682305] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.682597] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.682750] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.682919] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 6bdf0a78-b0ab-4b63-b5d7-224cfb192251 not found, creating... [ 732.683261] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.683444] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.683571] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.683793] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.683979] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.684280] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.684447] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.684570] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.684781] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.684913] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.691027] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 6bdf0a78-b0ab-4b63-b5d7-224cfb192251 is going to be created. [ 732.707818] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.708070] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.708205] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.708466] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.708838] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.709696] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-6bdf0a78-b0ab-4b63-b5d7-224cfb192251" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.899223] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5e555cc-4bc4-4e59-b77f-deda078818fb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.220899] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf in Status: SUCCESS [ 733.221184] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.386543] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 733.386731] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d deletion is rescheduled due to dependency. [ 733.386867] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.401012] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.401186] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.401256] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.401465] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.401557] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.401659] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5e555cc-4bc4-4e59-b77f-deda078818fb is going to be updated. [ 733.428083] env[69559]: INFO networking_nsxv3.common.synchronization [req-b9f3576b-805f-470d-90e1-be242d709ac1 req-f8285d91-c23f-4c0d-841b-73b3df1d4e91 service nova] Enqueued Resource ID: 99092389-59da-4e36-9a78-d2e1e7edec3e with Priority: HIGHEST for action security_group_rules [ 733.428271] env[69559]: INFO networking_nsxv3.common.synchronization [req-b9f3576b-805f-470d-90e1-be242d709ac1 req-f8285d91-c23f-4c0d-841b-73b3df1d4e91 service nova] Enqueued Resource ID: 99092389-59da-4e36-9a78-d2e1e7edec3e with Priority: HIGHEST for action security_group_members [ 733.428454] env[69559]: INFO networking_nsxv3.common.synchronization [req-b9f3576b-805f-470d-90e1-be242d709ac1 req-f8285d91-c23f-4c0d-841b-73b3df1d4e91 service nova] Enqueued Resource ID: 6bdf0a78-b0ab-4b63-b5d7-224cfb192251 with Priority: HIGHEST for action port [ 733.429052] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99092389-59da-4e36-9a78-d2e1e7edec3e with Priority: HIGHEST for action security_group_rules [ 733.429194] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99092389-59da-4e36-9a78-d2e1e7edec3e with Priority: HIGHEST for action security_group_members [ 733.429287] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bdf0a78-b0ab-4b63-b5d7-224cfb192251 with Priority: HIGHEST for action port [ 733.429649] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99092389-59da-4e36-9a78-d2e1e7edec3e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.429749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.429827] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.431038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.431038] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99092389-59da-4e36-9a78-d2e1e7edec3e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.432338] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-99092389-59da-4e36-9a78-d2e1e7edec3e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.432478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.432539] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.432739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.432890] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.432998] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.433076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.433221] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.435371] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.435371] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99092389-59da-4e36-9a78-d2e1e7edec3e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.435371] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bdf0a78-b0ab-4b63-b5d7-224cfb192251 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.435371] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bdf0a78-b0ab-4b63-b5d7-224cfb192251" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.435371] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bdf0a78-b0ab-4b63-b5d7-224cfb192251" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.435371] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bdf0a78-b0ab-4b63-b5d7-224cfb192251" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.435371] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bdf0a78-b0ab-4b63-b5d7-224cfb192251',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.462905] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.463163] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.463163] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.463338] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.463475] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.613571] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5e555cc-4bc4-4e59-b77f-deda078818fb in Status: IN_PROGRESS for 2s [ 733.938876] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99092389-59da-4e36-9a78-d2e1e7edec3e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.940567] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-99092389-59da-4e36-9a78-d2e1e7edec3e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.941896] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.941896] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6bdf0a78-b0ab-4b63-b5d7-224cfb192251 with status ACTIVE [ 733.941896] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.941896] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.941896] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.942819] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.942819] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.942819] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.942819] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.942819] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.943519] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.943519] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.944470] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.944470] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.944470] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.945212] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.945835] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.945945] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6bdf0a78-b0ab-4b63-b5d7-224cfb192251 is going to be updated. [ 733.966463] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.966463] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.966598] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.966994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.966994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.966994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bdf0a78-b0ab-4b63-b5d7-224cfb192251" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.448213] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99092389-59da-4e36-9a78-d2e1e7edec3e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.472127] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: SUCCESS [ 734.472127] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.472418] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.472634] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.472829] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.473034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.473094] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.473269] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.473342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.474714] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.951119] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.951288] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.951337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.951600] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.951686] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.951783] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99092389-59da-4e36-9a78-d2e1e7edec3e is going to be created. [ 734.974197] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.974351] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.974420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.974634] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.974793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.975975] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.976316] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.976392] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.976566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.976651] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.976835] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.976942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.977016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.977164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.977240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.977361] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e is going to be updated. [ 734.987277] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99092389-59da-4e36-9a78-d2e1e7edec3e in Status: UNINITIALIZED for 2s [ 735.000723] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.000894] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.000933] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.001158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.001294] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.009678] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: IN_PROGRESS for 2s [ 735.340591] env[69559]: INFO networking_nsxv3.common.synchronization [req-190365a2-b4d6-4591-85b8-14bc83891246 req-3240c888-a11b-4fa2-b588-0c74647518ad tempest-ServersWithSpecificFlavorTestJSON-1886354194 tempest-ServersWithSpecificFlavorTestJSON-1886354194-project-member] Enqueued Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGHEST for action security_group_members [ 735.340591] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGHEST for action security_group_members [ 735.345560] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-38ad73d3-d173-4ff2-9e1d-72777311ba4d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.345560] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.345560] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.345560] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.345560] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.345560] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.345560] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.345560] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.345560] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.345560] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.624851] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5e555cc-4bc4-4e59-b77f-deda078818fb in Status: SUCCESS [ 735.625689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.626471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.626762] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.627126] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.627339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.627456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.627757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.628090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.628152] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.628307] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5e555cc-4bc4-4e59-b77f-deda078818fb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.851027] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.851027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.851027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.851027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.851027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.851027] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.851027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.851027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.851027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.851027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.851027] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d is going to be updated. [ 735.874992] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.878525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.878525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.878525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.878525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.888518] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d in Status: IN_PROGRESS for 2s [ 736.131589] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5e555cc-4bc4-4e59-b77f-deda078818fb taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.131589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.131589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.131589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.131589] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.131589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.131833] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.131833] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.131888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.131967] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.132103] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5e555cc-4bc4-4e59-b77f-deda078818fb taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.132197] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.132246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.132385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.132516] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.132605] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.132662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.132792] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.133323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.133323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.133323] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5e555cc-4bc4-4e59-b77f-deda078818fb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.636131] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5e555cc-4bc4-4e59-b77f-deda078818fb: rpc.has_security_group_logging(os_id): False [ 736.654253] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.654423] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.654494] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.654729] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.654817] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.655032] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.655155] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.655220] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.655498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.655604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.655813] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.655990] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.656115] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.656311] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.656398] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.656629] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.656737] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.656807] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.656947] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.657042] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.657161] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5e555cc-4bc4-4e59-b77f-deda078818fb is going to be updated. [ 736.716355] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.716521] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.716595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.716834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.716979] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.728454] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5e555cc-4bc4-4e59-b77f-deda078818fb in Status: IN_PROGRESS for 2s [ 736.997106] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99092389-59da-4e36-9a78-d2e1e7edec3e in Status: SUCCESS [ 736.997340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.997509] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.997804] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.998009] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.998180] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.998299] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.998620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.000570] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.000712] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.000819] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99092389-59da-4e36-9a78-d2e1e7edec3e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.018036] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: SUCCESS [ 737.018240] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e deletion is rescheduled due to dependency. [ 737.018833] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.018833] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.018833] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.019010] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.019125] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.019185] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.019342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.019456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.019551] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.506457] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99092389-59da-4e36-9a78-d2e1e7edec3e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.522430] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.522535] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.522585] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.522800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.522883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.523101] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.523188] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.523312] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.523396] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.523468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.523553] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e is going to be updated. [ 737.554195] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.554195] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.554195] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.554195] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.554195] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.564103] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: IN_PROGRESS for 2s [ 737.902026] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d in Status: SUCCESS [ 737.902026] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d deletion is rescheduled due to dependency. [ 737.902026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.009049] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99092389-59da-4e36-9a78-d2e1e7edec3e: rpc.has_security_group_logging(os_id): False [ 738.027811] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.027811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.027811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.027811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.027811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.027811] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.027811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.027811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.027811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.027811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.027811] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99092389-59da-4e36-9a78-d2e1e7edec3e is going to be created. [ 738.111429] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.111578] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.111648] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.111850] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.112274] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.128075] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99092389-59da-4e36-9a78-d2e1e7edec3e in Status: IN_PROGRESS for 2s [ 738.740431] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5e555cc-4bc4-4e59-b77f-deda078818fb in Status: SUCCESS [ 738.740431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.549964] env[69559]: INFO networking_nsxv3.common.synchronization [req-35b79959-a9f9-456e-bea5-414d707cf191 req-c0024ef4-e7ff-46fe-800f-a43f8e9106ee tempest-ServerAddressesTestJSON-1295953973 tempest-ServerAddressesTestJSON-1295953973-project-member] Enqueued Resource ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 with Priority: HIGHEST for action security_group_members [ 739.550593] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 with Priority: HIGHEST for action security_group_members [ 739.558528] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-039c805f-b0b4-4b54-b42e-9f95c1e21442 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.558528] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.558528] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.558528] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.558528] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.558528] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.558528] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.558528] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.558528] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.558528] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('039c805f-b0b4-4b54-b42e-9f95c1e21442',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.574019] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: SUCCESS [ 739.574019] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e deletion is rescheduled due to dependency. [ 739.574019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.838929] env[69559]: INFO networking_nsxv3.common.synchronization [req-91d6d2e1-a819-4b97-bbab-9d0c97bc07ef req-07e0a160-9410-435f-b8bc-05813365d966 tempest-ServersAdminNegativeTestJSON-256921676 tempest-ServersAdminNegativeTestJSON-256921676-project-member] Enqueued Resource ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe with Priority: HIGHEST for action security_group_members [ 739.840370] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe with Priority: HIGHEST for action security_group_members [ 739.840370] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6bb8723-4212-49f6-9e0f-6762cf861cbe taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.840370] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.840370] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.843326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.843794] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.843794] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.843794] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.843984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.844088] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.844334] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6bb8723-4212-49f6-9e0f-6762cf861cbe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.060669] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.060835] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.060906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.061155] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.061257] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.061464] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.061561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.061617] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.061763] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.061835] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.061961] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 is going to be updated. [ 740.087572] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.087877] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.088010] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.088442] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.088640] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.097345] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 in Status: IN_PROGRESS for 2s [ 740.137572] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99092389-59da-4e36-9a78-d2e1e7edec3e in Status: SUCCESS [ 740.138152] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.246755] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.247032] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.247162] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.247434] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.247845] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.248118] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.248307] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.248527] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.248677] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.249746] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.249746] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.249746] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.249746] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.249746] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.249746] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.249746] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.267996] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.267996] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 740.267996] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.267996] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.268332] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-b1f5ea11-ae5a-4b83-9b3d-468f264c565f taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.268511] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-b1f5ea11-ae5a-4b83-9b3d-468f264c565f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.268683] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-b1f5ea11-ae5a-4b83-9b3d-468f264c565f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.269032] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-b1f5ea11-ae5a-4b83-9b3d-468f264c565f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.269179] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1f5ea11-ae5a-4b83-9b3d-468f264c565f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.350149] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6bb8723-4212-49f6-9e0f-6762cf861cbe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.773046] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.773473] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.773473] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.773861] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.774067] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.774281] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port b1f5ea11-ae5a-4b83-9b3d-468f264c565f not found, creating... [ 740.774612] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.774796] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.774943] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.775264] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.775476] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.775839] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.776056] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.776144] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.776365] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.776520] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.776653] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: b1f5ea11-ae5a-4b83-9b3d-468f264c565f is going to be created. [ 740.795834] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.796088] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.796234] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.796547] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.796867] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.797134] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-b1f5ea11-ae5a-4b83-9b3d-468f264c565f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.854110] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6bb8723-4212-49f6-9e0f-6762cf861cbe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.357747] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.357984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.358102] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.358488] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.358488] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.359143] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe is going to be updated. [ 741.385138] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.385337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.385430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.385804] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.385994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.398262] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe in Status: IN_PROGRESS for 2s [ 741.526023] env[69559]: INFO networking_nsxv3.common.synchronization [req-91d6d2e1-a819-4b97-bbab-9d0c97bc07ef req-9fe02b87-c172-465b-a226-74ccfc09ae59 service nova] Enqueued Resource ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe with Priority: HIGHEST for action security_group_rules [ 741.526023] env[69559]: INFO networking_nsxv3.common.synchronization [req-91d6d2e1-a819-4b97-bbab-9d0c97bc07ef req-9fe02b87-c172-465b-a226-74ccfc09ae59 service nova] Enqueued Resource ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe with Priority: HIGHEST for action security_group_members [ 741.526023] env[69559]: INFO networking_nsxv3.common.synchronization [req-91d6d2e1-a819-4b97-bbab-9d0c97bc07ef req-9fe02b87-c172-465b-a226-74ccfc09ae59 service nova] Enqueued Resource ID: b1f5ea11-ae5a-4b83-9b3d-468f264c565f with Priority: HIGHEST for action port [ 741.526023] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe with Priority: HIGHEST for action security_group_rules [ 741.526023] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe with Priority: HIGHEST for action security_group_members [ 741.526023] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1f5ea11-ae5a-4b83-9b3d-468f264c565f with Priority: HIGHEST for action port [ 741.526885] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6bb8723-4212-49f6-9e0f-6762cf861cbe taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.527308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.534420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.534420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.534420] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6bb8723-4212-49f6-9e0f-6762cf861cbe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.534420] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6bb8723-4212-49f6-9e0f-6762cf861cbe taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.534420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.534420] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1f5ea11-ae5a-4b83-9b3d-468f264c565f taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.534420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1f5ea11-ae5a-4b83-9b3d-468f264c565f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.534420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1f5ea11-ae5a-4b83-9b3d-468f264c565f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.534420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1f5ea11-ae5a-4b83-9b3d-468f264c565f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.534420] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1f5ea11-ae5a-4b83-9b3d-468f264c565f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.038781] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1f5ea11-ae5a-4b83-9b3d-468f264c565f with status ACTIVE [ 742.038781] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.039375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.039375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.039375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.039375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.039375] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.039727] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.039727] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.039727] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.039920] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.039982] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.040096] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.040185] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.040290] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.040372] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.040432] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1f5ea11-ae5a-4b83-9b3d-468f264c565f is going to be updated. [ 742.041835] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6bb8723-4212-49f6-9e0f-6762cf861cbe taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.041953] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.064021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.064021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.064021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.064021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.064021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.064021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1f5ea11-ae5a-4b83-9b3d-468f264c565f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.107851] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 in Status: SUCCESS [ 742.108209] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 deletion is rescheduled due to dependency. [ 742.108209] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.404644] env[69559]: INFO networking_nsxv3.common.synchronization [None req-dd76eb0d-e42c-426a-8764-b95ba1cc758e None None] Enqueued Resource ID: 74528239-57e8-42f0-b787-ec1186a455e8 with Priority: HIGHEST for action port [ 742.406197] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74528239-57e8-42f0-b787-ec1186a455e8 with Priority: HIGHEST for action port [ 742.406837] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-74528239-57e8-42f0-b787-ec1186a455e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.406966] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74528239-57e8-42f0-b787-ec1186a455e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.407053] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74528239-57e8-42f0-b787-ec1186a455e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.407358] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74528239-57e8-42f0-b787-ec1186a455e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.407439] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74528239-57e8-42f0-b787-ec1186a455e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.525021] env[69559]: INFO networking_nsxv3.common.synchronization [req-e0dde27d-b696-435a-bef2-a9b5496a6b3a req-3cb0ee9b-3542-4713-bcb4-6e4c81b9fddc tempest-ServerMetadataTestJSON-1807349597 tempest-ServerMetadataTestJSON-1807349597-project-member] Enqueued Resource ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e with Priority: HIGHEST for action security_group_members [ 742.525021] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e with Priority: HIGHEST for action security_group_members [ 742.525021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-40991716-c8be-41b4-b8c7-a3774f7dac8e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.525021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.525021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.525021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.525503] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.525793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.525974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.526261] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.526460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.527318] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40991716-c8be-41b4-b8c7-a3774f7dac8e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.869796] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-980 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.870048] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-980" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.870236] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-980" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.870565] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-980" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.870848] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.871027] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.871156] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.871371] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.871535] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.871744] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.871861] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.871973] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.872117] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.872232] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 742.872377] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.873030] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.905261] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.905389] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 742.905555] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.905754] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-980" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.906078] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-ff3d2200-c7a6-4d27-b5a4-df50ba3a246b taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.906264] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-ff3d2200-c7a6-4d27-b5a4-df50ba3a246b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.906387] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-ff3d2200-c7a6-4d27-b5a4-df50ba3a246b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.906700] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-ff3d2200-c7a6-4d27-b5a4-df50ba3a246b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.906857] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff3d2200-c7a6-4d27-b5a4-df50ba3a246b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.911809] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74528239-57e8-42f0-b787-ec1186a455e8 [ 742.911809] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.911809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.911809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.911809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.912184] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.912184] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74528239-57e8-42f0-b787-ec1186a455e8 already deleted. [ 742.912184] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74528239-57e8-42f0-b787-ec1186a455e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.030445] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.030445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.030445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.030445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.030445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.030445] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.030445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.030445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.030445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.030445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.030445] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e already deleted. [ 743.030445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.410076] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.410500] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.410500] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.410812] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.410985] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.411291] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port ff3d2200-c7a6-4d27-b5a4-df50ba3a246b not found, creating... [ 743.411711] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.411961] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.412202] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.413792] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.413792] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.413792] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.413792] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.413792] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.414140] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.414140] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.414342] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: ff3d2200-c7a6-4d27-b5a4-df50ba3a246b is going to be created. [ 743.416612] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe in Status: SUCCESS [ 743.416879] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.417101] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.417338] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.417552] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.417807] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.417899] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.418135] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.418255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.418367] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6bb8723-4212-49f6-9e0f-6762cf861cbe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.441135] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.441440] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.441591] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.442204] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.442204] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.442458] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-ff3d2200-c7a6-4d27-b5a4-df50ba3a246b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.921325] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6bb8723-4212-49f6-9e0f-6762cf861cbe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.379238] env[69559]: INFO networking_nsxv3.common.synchronization [req-e0dde27d-b696-435a-bef2-a9b5496a6b3a req-b6b34ab5-25c8-4437-8641-1392dd6ff899 service nova] Enqueued Resource ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e with Priority: HIGHEST for action security_group_rules [ 744.379490] env[69559]: INFO networking_nsxv3.common.synchronization [req-e0dde27d-b696-435a-bef2-a9b5496a6b3a req-b6b34ab5-25c8-4437-8641-1392dd6ff899 service nova] Enqueued Resource ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e with Priority: HIGHEST for action security_group_members [ 744.379727] env[69559]: INFO networking_nsxv3.common.synchronization [req-e0dde27d-b696-435a-bef2-a9b5496a6b3a req-b6b34ab5-25c8-4437-8641-1392dd6ff899 service nova] Enqueued Resource ID: ff3d2200-c7a6-4d27-b5a4-df50ba3a246b with Priority: HIGHEST for action port [ 744.384743] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e with Priority: HIGHEST for action security_group_rules [ 744.384976] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e with Priority: HIGHEST for action security_group_members [ 744.387090] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff3d2200-c7a6-4d27-b5a4-df50ba3a246b with Priority: HIGHEST for action port [ 744.387090] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40991716-c8be-41b4-b8c7-a3774f7dac8e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.387090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.387090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.387090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.387090] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40991716-c8be-41b4-b8c7-a3774f7dac8e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.389989] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-40991716-c8be-41b4-b8c7-a3774f7dac8e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.390189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.390291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.390955] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.391325] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.391325] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.391489] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.391686] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.391775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.392147] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40991716-c8be-41b4-b8c7-a3774f7dac8e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.393578] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff3d2200-c7a6-4d27-b5a4-df50ba3a246b taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.393734] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff3d2200-c7a6-4d27-b5a4-df50ba3a246b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.393924] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff3d2200-c7a6-4d27-b5a4-df50ba3a246b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.394586] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff3d2200-c7a6-4d27-b5a4-df50ba3a246b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.394908] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff3d2200-c7a6-4d27-b5a4-df50ba3a246b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.423947] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6bb8723-4212-49f6-9e0f-6762cf861cbe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.765154] env[69559]: INFO networking_nsxv3.common.synchronization [None req-f1362718-9f39-4d88-91f8-62f3fcded8d3 None None] Enqueued Resource ID: b0b42eb2-d383-4eeb-ad29-136290c9aec3 with Priority: HIGHEST for action port [ 744.765154] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b42eb2-d383-4eeb-ad29-136290c9aec3 with Priority: HIGHEST for action port [ 744.765154] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0b42eb2-d383-4eeb-ad29-136290c9aec3 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.765154] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0b42eb2-d383-4eeb-ad29-136290c9aec3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.765154] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0b42eb2-d383-4eeb-ad29-136290c9aec3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.765154] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0b42eb2-d383-4eeb-ad29-136290c9aec3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.765703] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0b42eb2-d383-4eeb-ad29-136290c9aec3',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.890504] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-40991716-c8be-41b4-b8c7-a3774f7dac8e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.890838] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.896346] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40991716-c8be-41b4-b8c7-a3774f7dac8e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.898470] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff3d2200-c7a6-4d27-b5a4-df50ba3a246b with status ACTIVE [ 744.898714] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.899148] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.899148] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.899554] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.899554] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.900237] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.900237] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.900237] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.900237] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.900237] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.903904] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.903904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.903904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.903904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.903904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.903904] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff3d2200-c7a6-4d27-b5a4-df50ba3a246b is going to be updated. [ 744.921899] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.922024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.922637] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.922637] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.922839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.923145] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff3d2200-c7a6-4d27-b5a4-df50ba3a246b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.926543] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.926543] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.926543] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.927613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.927761] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.927893] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe is going to be updated. [ 744.968691] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.968908] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.969033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.969275] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.969463] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.995261] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe in Status: IN_PROGRESS for 2s [ 745.268283] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0b42eb2-d383-4eeb-ad29-136290c9aec3 [ 745.268511] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.268664] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.268800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.268945] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.269050] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.269147] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0b42eb2-d383-4eeb-ad29-136290c9aec3 already deleted. [ 745.269297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0b42eb2-d383-4eeb-ad29-136290c9aec3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.403353] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40991716-c8be-41b4-b8c7-a3774f7dac8e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.908251] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.908581] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.908581] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.908741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.910092] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.910092] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e is going to be created. [ 745.939045] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.939217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.939299] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.939561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.939764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.952246] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e in Status: UNINITIALIZED for 2s [ 746.402748] env[69559]: INFO networking_nsxv3.common.synchronization [None req-6202fb39-bd1b-4dff-b0c2-b52c0aaad1ec tempest-MigrationsAdminTest-370955767 tempest-MigrationsAdminTest-370955767-project-member] Enqueued Resource ID: f41d6194-7d18-487a-b8ff-858f741de94a with Priority: HIGHEST for action security_group_rules [ 746.403643] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f41d6194-7d18-487a-b8ff-858f741de94a with Priority: HIGHEST for action security_group_rules [ 746.403776] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f41d6194-7d18-487a-b8ff-858f741de94a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.403921] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f41d6194-7d18-487a-b8ff-858f741de94a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.403993] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f41d6194-7d18-487a-b8ff-858f741de94a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.404343] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f41d6194-7d18-487a-b8ff-858f741de94a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.404439] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f41d6194-7d18-487a-b8ff-858f741de94a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.510308] env[69559]: INFO networking_nsxv3.common.synchronization [None req-1ad1242b-19ac-440b-adfc-2a2cbbbd0752 tempest-MigrationsAdminTest-370955767 tempest-MigrationsAdminTest-370955767-project-member] Enqueued Resource ID: f41d6194-7d18-487a-b8ff-858f741de94a with Priority: HIGHEST for action security_group_rules [ 746.510924] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f41d6194-7d18-487a-b8ff-858f741de94a with Priority: HIGHEST for action security_group_rules [ 746.511433] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f41d6194-7d18-487a-b8ff-858f741de94a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.511433] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f41d6194-7d18-487a-b8ff-858f741de94a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.924370] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.924689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.924689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.924826] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.924916] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.925019] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f41d6194-7d18-487a-b8ff-858f741de94a already deleted. [ 746.925105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f41d6194-7d18-487a-b8ff-858f741de94a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.925256] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f41d6194-7d18-487a-b8ff-858f741de94a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.925405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f41d6194-7d18-487a-b8ff-858f741de94a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.925485] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f41d6194-7d18-487a-b8ff-858f741de94a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.004985] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe in Status: SUCCESS [ 747.005250] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.005528] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.005885] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.006112] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.006238] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.006340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.006538] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.006634] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.006725] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.006816] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6bb8723-4212-49f6-9e0f-6762cf861cbe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.456020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.456020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.456020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.456020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.456020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.456020] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f41d6194-7d18-487a-b8ff-858f741de94a already deleted. [ 747.456020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f41d6194-7d18-487a-b8ff-858f741de94a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.509817] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6bb8723-4212-49f6-9e0f-6762cf861cbe taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.510077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.510077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.510377] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.510564] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.510711] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.510756] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.510981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.511071] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.511156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.511335] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6bb8723-4212-49f6-9e0f-6762cf861cbe taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.511459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.512397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.512608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.512802] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.512904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.512963] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.513126] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.513200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.513422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.513422] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6bb8723-4212-49f6-9e0f-6762cf861cbe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.962167] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e in Status: SUCCESS [ 747.962578] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.962578] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.962744] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.963079] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.963210] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.963286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.963434] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.963579] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.963644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.963940] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40991716-c8be-41b4-b8c7-a3774f7dac8e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.966539] env[69559]: INFO networking_nsxv3.common.synchronization [req-8b17bdff-d00c-42f9-9c1b-c69786c02f27 req-506629ea-78bd-44d5-80e5-8553772709c7 tempest-DeleteServersAdminTestJSON-301366711 tempest-DeleteServersAdminTestJSON-301366711-project-member] Enqueued Resource ID: b5e555cc-4bc4-4e59-b77f-deda078818fb with Priority: HIGHEST for action security_group_members [ 747.966653] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5e555cc-4bc4-4e59-b77f-deda078818fb with Priority: HIGHEST for action security_group_members [ 747.967220] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5e555cc-4bc4-4e59-b77f-deda078818fb taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.967323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.967323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.967506] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.967657] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.967836] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.967923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.968086] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.968165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.968254] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5e555cc-4bc4-4e59-b77f-deda078818fb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.021707] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6bb8723-4212-49f6-9e0f-6762cf861cbe: rpc.has_security_group_logging(os_id): False [ 748.040151] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.040151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.040151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.040311] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.040445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.040622] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.040731] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.040802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.040970] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.041089] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.042093] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.042093] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.042093] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.042093] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.042093] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.042093] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.042093] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.042093] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.042492] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.042641] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.042813] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe is going to be updated. [ 748.134083] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.134286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.134345] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.134629] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.134724] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.148151] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe in Status: IN_PROGRESS for 2s [ 748.466139] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-40991716-c8be-41b4-b8c7-a3774f7dac8e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.466604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.466763] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.467270] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.467572] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.467892] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.468060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.468294] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.468456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.468613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.468858] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-40991716-c8be-41b4-b8c7-a3774f7dac8e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.469067] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.470025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.470025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.470025] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.470025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.470025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.470025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.470025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.470025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.474018] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40991716-c8be-41b4-b8c7-a3774f7dac8e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.474018] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.474018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.474018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.474018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.474018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.474018] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.474018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.474018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.474018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.474018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.474018] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5e555cc-4bc4-4e59-b77f-deda078818fb is going to be updated. [ 748.504261] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.504402] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.504475] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.504691] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.505049] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.514018] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5e555cc-4bc4-4e59-b77f-deda078818fb in Status: IN_PROGRESS for 2s [ 748.975729] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40991716-c8be-41b4-b8c7-a3774f7dac8e: rpc.has_security_group_logging(os_id): False [ 748.993812] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.994019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.994098] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.994319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.995052] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.995052] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.995052] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.995052] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.995052] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.995385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.995385] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.995475] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.995475] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.995598] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.995912] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.995972] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.996061] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.996182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.996289] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.996336] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.996410] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e is going to be created. [ 749.054866] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.055038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.055259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.055385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.055736] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.070424] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e in Status: IN_PROGRESS for 2s [ 749.429457] env[69559]: INFO networking_nsxv3.common.synchronization [req-7789c47b-771f-4720-a140-a16ca5862177 req-7861bd35-540e-4c02-b816-54a22f7ed02a tempest-InstanceActionsNegativeTestJSON-296914521 tempest-InstanceActionsNegativeTestJSON-296914521-project-member] Enqueued Resource ID: c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 with Priority: HIGHEST for action security_group_members [ 749.430131] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 with Priority: HIGHEST for action security_group_members [ 749.430439] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.430562] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.430617] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.431686] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.431982] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.433384] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.433447] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.433648] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.433796] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.433931] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c225ff1a-79ed-4da1-ac55-3b8ee41f70a5',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.936214] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.936377] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.936447] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.936658] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.936749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.936946] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.937058] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.937120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.937250] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.937322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.937398] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 already deleted. [ 749.937475] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.955191] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-620 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.955394] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-620" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.955519] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-620" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.955848] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-620" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.958729] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.958729] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.958729] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.958729] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.958729] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.958729] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.958729] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 749.958729] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 749.958729] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 749.958729] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 749.958729] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 749.958729] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 749.975988] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 749.976260] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 749.976300] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 749.976468] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-620" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.976766] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-abffc0ef-73bd-431d-9d13-98c1b48c02a6 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.976931] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-abffc0ef-73bd-431d-9d13-98c1b48c02a6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.977069] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-abffc0ef-73bd-431d-9d13-98c1b48c02a6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.977358] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-abffc0ef-73bd-431d-9d13-98c1b48c02a6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.977537] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abffc0ef-73bd-431d-9d13-98c1b48c02a6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.160069] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe in Status: SUCCESS [ 750.160344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.210186] env[69559]: INFO networking_nsxv3.common.synchronization [req-047add0d-e213-48b6-9a3f-8418752f9a1f req-d778d8ae-a13e-4d47-bb49-ccfda34899b0 tempest-ImagesTestJSON-1150485476 tempest-ImagesTestJSON-1150485476-project-member] Enqueued Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 750.210186] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 750.210186] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.210186] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.210186] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.214252] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.214448] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.214564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.214627] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.214821] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.214923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.215037] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.480392] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.480620] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.480751] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.481044] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.481201] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.481355] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port abffc0ef-73bd-431d-9d13-98c1b48c02a6 not found, creating... [ 750.481615] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.481773] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.481895] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.482124] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.482263] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.482539] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.482699] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.483779] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.484151] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.484326] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.484475] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: abffc0ef-73bd-431d-9d13-98c1b48c02a6 is going to be created. [ 750.504344] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.504573] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.504698] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.504960] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.505201] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.505420] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-abffc0ef-73bd-431d-9d13-98c1b48c02a6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.522687] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5e555cc-4bc4-4e59-b77f-deda078818fb in Status: SUCCESS [ 750.522914] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5e555cc-4bc4-4e59-b77f-deda078818fb deletion is rescheduled due to dependency. [ 750.523386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5e555cc-4bc4-4e59-b77f-deda078818fb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.717439] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.717676] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.717828] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.718101] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.718229] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.718459] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.718627] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.718865] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.718935] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.719078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.719204] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 is going to be updated. [ 750.744442] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.744715] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.745045] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.745156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.745338] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.754508] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: IN_PROGRESS for 2s [ 751.081103] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e in Status: SUCCESS [ 751.081445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.369134] env[69559]: INFO networking_nsxv3.common.synchronization [req-7789c47b-771f-4720-a140-a16ca5862177 req-75ba9b70-b526-4797-8687-140eb0085844 service nova] Enqueued Resource ID: c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 with Priority: HIGHEST for action security_group_rules [ 751.369441] env[69559]: INFO networking_nsxv3.common.synchronization [req-7789c47b-771f-4720-a140-a16ca5862177 req-75ba9b70-b526-4797-8687-140eb0085844 service nova] Enqueued Resource ID: c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 with Priority: HIGHEST for action security_group_members [ 751.369589] env[69559]: INFO networking_nsxv3.common.synchronization [req-7789c47b-771f-4720-a140-a16ca5862177 req-75ba9b70-b526-4797-8687-140eb0085844 service nova] Enqueued Resource ID: abffc0ef-73bd-431d-9d13-98c1b48c02a6 with Priority: HIGHEST for action port [ 751.373849] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 with Priority: HIGHEST for action security_group_rules [ 751.373849] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 with Priority: HIGHEST for action security_group_members [ 751.373849] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abffc0ef-73bd-431d-9d13-98c1b48c02a6 with Priority: HIGHEST for action port [ 751.373849] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.373849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.373849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.373849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.373849] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c225ff1a-79ed-4da1-ac55-3b8ee41f70a5',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.373849] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.373849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.373849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.374557] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.374760] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.374924] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.375741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.375741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.375741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.375741] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c225ff1a-79ed-4da1-ac55-3b8ee41f70a5',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.376685] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-abffc0ef-73bd-431d-9d13-98c1b48c02a6 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.378706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abffc0ef-73bd-431d-9d13-98c1b48c02a6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.378706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abffc0ef-73bd-431d-9d13-98c1b48c02a6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.378706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abffc0ef-73bd-431d-9d13-98c1b48c02a6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.378706] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abffc0ef-73bd-431d-9d13-98c1b48c02a6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.879478] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.880640] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.880930] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c225ff1a-79ed-4da1-ac55-3b8ee41f70a5',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.882164] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abffc0ef-73bd-431d-9d13-98c1b48c02a6 with status ACTIVE [ 751.884017] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.884017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.884017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.884017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.884017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.884017] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.884334] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.884389] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.884556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.884631] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.884830] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.884920] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.884978] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.885123] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.885191] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.885305] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abffc0ef-73bd-431d-9d13-98c1b48c02a6 is going to be updated. [ 751.906060] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.906060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.906060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.906204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.906233] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.906629] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abffc0ef-73bd-431d-9d13-98c1b48c02a6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.198155] env[69559]: INFO networking_nsxv3.common.synchronization [req-061175e0-c2af-490e-ba68-a299de3476a1 req-0e3eb3aa-67d4-40d9-a0db-bb78af73e6a4 tempest-AttachInterfacesUnderV243Test-114660582 tempest-AttachInterfacesUnderV243Test-114660582-project-member] Enqueued Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_members [ 752.198155] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_members [ 752.198155] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-1068186a-ec83-4273-b088-3f5610ae229e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.198546] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.198546] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.199412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.199612] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.199714] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.199786] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.199969] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.200082] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.200180] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.387412] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c225ff1a-79ed-4da1-ac55-3b8ee41f70a5',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.705399] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.705732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.706067] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.707244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.707244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.707244] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.707244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.707244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.707244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.707244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.707244] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1068186a-ec83-4273-b088-3f5610ae229e already deleted. [ 752.707244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.764409] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.764841] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-690" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.765102] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-690" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.765610] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-690" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.766076] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.768767] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.768942] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.769302] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.769525] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.769817] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 752.770031] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 752.770311] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 752.770548] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 752.770795] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 752.771558] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 752.771558] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 752.784901] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: SUCCESS [ 752.785108] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 deletion is rescheduled due to dependency. [ 752.785222] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.790244] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 752.790647] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 752.790721] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 752.790995] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-690" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.791457] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.791657] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.791784] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.792237] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.792237] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.893384] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.893564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.893608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.893830] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.893919] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.894100] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 is going to be created. [ 752.926880] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.926880] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.926880] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.926880] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.927234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.939754] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 in Status: UNINITIALIZED for 2s [ 753.294534] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.294986] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.294986] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.295214] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.295335] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.295548] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7 not found, creating... [ 753.295750] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.295930] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.296064] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.296285] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.296424] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.296708] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.296864] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.297047] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.297211] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.297344] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.297483] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7 is going to be created. [ 753.318441] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.318633] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.318724] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.319020] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.319250] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.319474] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.805024] env[69559]: INFO networking_nsxv3.common.synchronization [req-d12a0ca0-8124-412d-8b66-0d68fcbd3d41 req-ffa0c512-afa0-4ff3-9686-0f95d281fff1 tempest-ListImageFiltersTestJSON-342177122 tempest-ListImageFiltersTestJSON-342177122-project-member] Enqueued Resource ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 with Priority: HIGHEST for action security_group_members [ 753.805566] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 with Priority: HIGHEST for action security_group_members [ 753.805889] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.806366] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.806486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.806698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.806862] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.806968] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.807043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.807196] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.807280] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.807374] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d3ab8f7-3874-4370-9e84-4a90ecd908d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.137835] env[69559]: INFO networking_nsxv3.common.synchronization [req-061175e0-c2af-490e-ba68-a299de3476a1 req-4bada51c-7219-492a-aea7-893459be2300 service nova] Enqueued Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_rules [ 754.138032] env[69559]: INFO networking_nsxv3.common.synchronization [req-061175e0-c2af-490e-ba68-a299de3476a1 req-4bada51c-7219-492a-aea7-893459be2300 service nova] Enqueued Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_members [ 754.138032] env[69559]: INFO networking_nsxv3.common.synchronization [req-061175e0-c2af-490e-ba68-a299de3476a1 req-4bada51c-7219-492a-aea7-893459be2300 service nova] Enqueued Resource ID: acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7 with Priority: HIGHEST for action port [ 754.138253] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_rules [ 754.138376] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_members [ 754.138468] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7 with Priority: HIGHEST for action port [ 754.139028] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1068186a-ec83-4273-b088-3f5610ae229e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.139326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.139430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.139882] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.139882] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.140934] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-1068186a-ec83-4273-b088-3f5610ae229e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.141144] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.141233] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.141413] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.141560] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.141655] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.141717] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.141855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.142053] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.142053] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.143356] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.143463] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.143523] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.143672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.143745] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.311359] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d3ab8f7-3874-4370-9e84-4a90ecd908d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.641964] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-1068186a-ec83-4273-b088-3f5610ae229e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.642121] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.644053] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.646021] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7 with status ACTIVE [ 754.646215] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.646328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.646393] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.646589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.646678] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.646847] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.646944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.647010] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.647158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.647231] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.647403] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.647492] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.647550] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.647681] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.647774] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.647854] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7 is going to be updated. [ 754.668358] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.668358] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.668358] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.668358] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.668358] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.668626] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.815882] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d3ab8f7-3874-4370-9e84-4a90ecd908d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.952492] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 in Status: SUCCESS [ 754.952704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.952866] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.953094] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.953331] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.953446] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.953446] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.953595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.953671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.953750] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.953835] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c225ff1a-79ed-4da1-ac55-3b8ee41f70a5',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.146410] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.318204] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.318584] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.318584] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.318673] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.318775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.318842] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 is going to be updated. [ 755.344042] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.344205] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.344316] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.344486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.344627] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.352330] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 in Status: IN_PROGRESS for 2s [ 755.459208] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.459208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.459208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.459208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.459208] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.459208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.459208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.459208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.459208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.459208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.459208] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.459208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.459208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.459208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.459208] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.459208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.459771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.459771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.459771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.459771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.459771] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c225ff1a-79ed-4da1-ac55-3b8ee41f70a5',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.651919] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.652091] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.652161] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.652385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.652455] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.652552] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1068186a-ec83-4273-b088-3f5610ae229e is going to be created. [ 755.674385] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.674553] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.674614] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.674790] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.674943] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.682811] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1068186a-ec83-4273-b088-3f5610ae229e in Status: UNINITIALIZED for 2s [ 755.963343] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c225ff1a-79ed-4da1-ac55-3b8ee41f70a5: rpc.has_security_group_logging(os_id): False [ 755.980868] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.981063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.981154] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.981446] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.981546] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.981752] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.981854] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.981919] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.982089] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.982643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.982643] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.982643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.982643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.982846] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.982891] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.983111] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.983273] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.983347] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.983499] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.983629] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.983678] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 is going to be created. [ 756.036515] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.036726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.036825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.037102] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.037392] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.050220] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 in Status: IN_PROGRESS for 2s [ 756.991902] env[69559]: INFO networking_nsxv3.common.synchronization [req-5fa9d728-cfff-4a9d-99cd-9718ef8288b8 req-3ea1692f-2d42-4518-bfc1-456b36109b0e tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 with Priority: HIGHEST for action security_group_members [ 756.992438] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 with Priority: HIGHEST for action security_group_members [ 756.992732] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-858bd0a1-9ee5-49c8-ac77-f218758ad913 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.992852] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.992917] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.993238] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.993399] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.993503] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.993565] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.993721] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.993808] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.993900] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('858bd0a1-9ee5-49c8-ac77-f218758ad913',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.284030] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.284245] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.284373] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.284706] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.285093] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.285199] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.285323] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.285541] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.285694] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.285903] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.286032] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 757.286142] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 757.286248] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 757.286566] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.286566] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 757.286671] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 757.304939] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 757.305149] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 757.305297] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 757.305478] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.305872] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-cc929fbb-6406-44eb-8b75-17d477743a3f taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.306505] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-cc929fbb-6406-44eb-8b75-17d477743a3f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.306505] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-cc929fbb-6406-44eb-8b75-17d477743a3f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.306631] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-cc929fbb-6406-44eb-8b75-17d477743a3f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.306708] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc929fbb-6406-44eb-8b75-17d477743a3f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.362592] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 in Status: SUCCESS [ 757.362831] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.496383] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.496535] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.496599] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.496804] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.496886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.497092] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.497190] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.497291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.497391] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.497470] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.497547] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 already deleted. [ 757.497625] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.692544] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1068186a-ec83-4273-b088-3f5610ae229e in Status: SUCCESS [ 757.692766] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.692952] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.693163] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.693360] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.693470] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.693535] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.693697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.693804] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.693981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.694462] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.809285] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.809571] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.809704] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.809992] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.810204] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.810423] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port cc929fbb-6406-44eb-8b75-17d477743a3f not found, creating... [ 757.810739] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.810995] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.811083] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.811276] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.811422] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.811710] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.811905] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.812074] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.812308] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.812449] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.812594] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: cc929fbb-6406-44eb-8b75-17d477743a3f is going to be created. [ 757.832559] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.832808] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.832990] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.833304] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.833545] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.833775] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-cc929fbb-6406-44eb-8b75-17d477743a3f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.064192] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 in Status: SUCCESS [ 758.064574] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.196649] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.415481] env[69559]: INFO networking_nsxv3.common.synchronization [req-45ff25e8-ccae-4cbf-adfe-b722c57ad34b req-d5048eb8-b51b-479b-aa95-7641c4a6537b tempest-ServersAdminNegativeTestJSON-256921676 tempest-ServersAdminNegativeTestJSON-256921676-project-member] Enqueued Resource ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe with Priority: HIGHEST for action security_group_members [ 758.419558] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe with Priority: HIGHEST for action security_group_members [ 758.419877] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6bb8723-4212-49f6-9e0f-6762cf861cbe taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.420014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.420400] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.420605] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.420800] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.421019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.421096] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.421428] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.421541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.421637] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6bb8723-4212-49f6-9e0f-6762cf861cbe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.536450] env[69559]: INFO networking_nsxv3.common.synchronization [req-5fa9d728-cfff-4a9d-99cd-9718ef8288b8 req-b1be89b3-85a1-4d45-b692-6dbc704667fe service nova] Enqueued Resource ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 with Priority: HIGHEST for action security_group_rules [ 758.536630] env[69559]: INFO networking_nsxv3.common.synchronization [req-5fa9d728-cfff-4a9d-99cd-9718ef8288b8 req-b1be89b3-85a1-4d45-b692-6dbc704667fe service nova] Enqueued Resource ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 with Priority: HIGHEST for action security_group_members [ 758.536792] env[69559]: INFO networking_nsxv3.common.synchronization [req-5fa9d728-cfff-4a9d-99cd-9718ef8288b8 req-b1be89b3-85a1-4d45-b692-6dbc704667fe service nova] Enqueued Resource ID: cc929fbb-6406-44eb-8b75-17d477743a3f with Priority: HIGHEST for action port [ 758.536986] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 with Priority: HIGHEST for action security_group_rules [ 758.537201] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 with Priority: HIGHEST for action security_group_members [ 758.537304] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc929fbb-6406-44eb-8b75-17d477743a3f with Priority: HIGHEST for action port [ 758.537838] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-858bd0a1-9ee5-49c8-ac77-f218758ad913 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.537969] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.540121] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.542073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.542073] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('858bd0a1-9ee5-49c8-ac77-f218758ad913',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.542963] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-858bd0a1-9ee5-49c8-ac77-f218758ad913 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.545682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.545682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.545682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.545682] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.545682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.545682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.545682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.545682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.545682] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('858bd0a1-9ee5-49c8-ac77-f218758ad913',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.545682] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc929fbb-6406-44eb-8b75-17d477743a3f taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.549279] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc929fbb-6406-44eb-8b75-17d477743a3f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.549279] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc929fbb-6406-44eb-8b75-17d477743a3f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.549279] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc929fbb-6406-44eb-8b75-17d477743a3f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.549279] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc929fbb-6406-44eb-8b75-17d477743a3f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.593500] env[69559]: INFO networking_nsxv3.common.synchronization [req-b037e463-6651-45ff-81d1-4d855847c5e4 req-6bf2827d-ad92-446f-acbf-94a76e0d9626 tempest-ServerMetadataTestJSON-1807349597 tempest-ServerMetadataTestJSON-1807349597-project-member] Enqueued Resource ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e with Priority: HIGHEST for action security_group_members [ 758.594600] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e with Priority: HIGHEST for action security_group_members [ 758.594775] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-40991716-c8be-41b4-b8c7-a3774f7dac8e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.595032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.595246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.595579] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.595800] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.597967] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.597967] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.597967] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.597967] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.597967] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40991716-c8be-41b4-b8c7-a3774f7dac8e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.705180] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1068186a-ec83-4273-b088-3f5610ae229e: rpc.has_security_group_logging(os_id): False [ 758.721693] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.722200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.722365] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.722685] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.722999] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.723395] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.723624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.723779] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.724055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.724230] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.724392] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1068186a-ec83-4273-b088-3f5610ae229e is going to be created. [ 758.784346] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.784346] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.784346] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.784346] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.784346] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.793146] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1068186a-ec83-4273-b088-3f5610ae229e in Status: IN_PROGRESS for 2s [ 758.927021] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6bb8723-4212-49f6-9e0f-6762cf861cbe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.049879] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-858bd0a1-9ee5-49c8-ac77-f218758ad913 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.050137] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.050207] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('858bd0a1-9ee5-49c8-ac77-f218758ad913',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.051078] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc929fbb-6406-44eb-8b75-17d477743a3f with status ACTIVE [ 759.051854] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.051854] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.051854] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.051854] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.051854] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.051854] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.052117] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.052117] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.052178] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.052206] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.052511] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.052511] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.052511] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.052704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.052704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.052872] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc929fbb-6406-44eb-8b75-17d477743a3f is going to be updated. [ 759.074157] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.074157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.074157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.074157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.074516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.074516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc929fbb-6406-44eb-8b75-17d477743a3f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.102398] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.102398] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.102398] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.102398] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.102398] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.102398] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.102398] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.102398] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.102398] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.102398] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.102398] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e is going to be updated. [ 759.133146] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.134017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.134198] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.134480] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.134703] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.143925] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e in Status: IN_PROGRESS for 2s [ 759.425513] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6bb8723-4212-49f6-9e0f-6762cf861cbe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.555393] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('858bd0a1-9ee5-49c8-ac77-f218758ad913',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.928422] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.928629] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.928706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.928995] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.929087] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.929123] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe is going to be updated. [ 759.957675] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.957883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.957957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.958220] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.958339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.966288] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe in Status: IN_PROGRESS for 2s [ 760.057972] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.058174] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.058258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.058497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.058599] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.058700] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 is going to be created. [ 760.101529] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.101529] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.101529] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.101963] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.101963] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.110583] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 in Status: UNINITIALIZED for 2s [ 760.807548] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1068186a-ec83-4273-b088-3f5610ae229e in Status: SUCCESS [ 760.807783] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.153465] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e in Status: SUCCESS [ 761.153711] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e deletion is rescheduled due to dependency. [ 761.153746] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.975603] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe in Status: SUCCESS [ 761.975824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.127964] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 in Status: SUCCESS [ 762.128182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.128346] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.128813] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.128813] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.129017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.129102] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.129298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.129386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.129471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.129559] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('858bd0a1-9ee5-49c8-ac77-f218758ad913',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.632159] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('858bd0a1-9ee5-49c8-ac77-f218758ad913',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.135039] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 858bd0a1-9ee5-49c8-ac77-f218758ad913: rpc.has_security_group_logging(os_id): False [ 763.153666] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.153666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.153791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.153961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.154077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.154333] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.155231] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.155313] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.155513] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.155597] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.155685] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 is going to be created. [ 763.219022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.219022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.219022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.219022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.219022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.258922] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 in Status: IN_PROGRESS for 2s [ 763.598842] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 763.598842] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 764.053981] env[69559]: INFO networking_nsxv3.common.synchronization [req-e8f11b80-636d-4439-bbc7-c28691ae51b5 req-efa0a0c9-a8d4-452d-9e80-0027c5106564 tempest-ServerRescueTestJSON-155966181 tempest-ServerRescueTestJSON-155966181-project-member] Enqueued Resource ID: 734f0202-8a2d-48a6-8b16-336653a0c857 with Priority: HIGHEST for action security_group_members [ 764.055289] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 734f0202-8a2d-48a6-8b16-336653a0c857 with Priority: HIGHEST for action security_group_members [ 764.055592] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-734f0202-8a2d-48a6-8b16-336653a0c857 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.055854] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.055854] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.056245] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.056477] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.056622] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.056720] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.056914] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.057057] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.057206] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.348606] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-504 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.348798] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-504" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.348934] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-504" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.349270] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-504" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.349558] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.349715] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.349829] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.350063] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.350208] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.350403] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 764.350512] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 764.350616] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 764.350720] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 764.350844] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 764.350970] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 764.351114] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 764.370055] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 764.370260] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 764.370415] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 764.370589] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-504" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.370893] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-c3c8b29a-f337-4652-9709-ed6c9230783e taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.371098] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-c3c8b29a-f337-4652-9709-ed6c9230783e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.371759] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-c3c8b29a-f337-4652-9709-ed6c9230783e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.371759] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-c3c8b29a-f337-4652-9709-ed6c9230783e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.371759] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3c8b29a-f337-4652-9709-ed6c9230783e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.559517] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.559707] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.559844] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.560035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.560132] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.560328] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.560426] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.560489] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.560640] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.560710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.560796] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 734f0202-8a2d-48a6-8b16-336653a0c857 already deleted. [ 764.560872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.669924] env[69559]: INFO networking_nsxv3.common.synchronization [req-d04b1eb8-1f32-41fb-9f4d-fcf92bc4ec5c req-b6aea02a-eeb5-45c8-ba01-d6d4bf4d717a tempest-InstanceActionsNegativeTestJSON-296914521 tempest-InstanceActionsNegativeTestJSON-296914521-project-member] Enqueued Resource ID: c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 with Priority: HIGHEST for action security_group_members [ 764.670556] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 with Priority: HIGHEST for action security_group_members [ 764.671731] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.672040] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.672040] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.672150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.672359] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.672483] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.672888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.672888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.672888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.673104] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c225ff1a-79ed-4da1-ac55-3b8ee41f70a5',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.874750] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.875104] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.875181] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.875952] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.875952] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.875952] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port c3c8b29a-f337-4652-9709-ed6c9230783e not found, creating... [ 764.875952] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.876199] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.876251] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.876485] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.876648] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.876939] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.877115] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.877238] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.877481] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.877623] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.877785] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: c3c8b29a-f337-4652-9709-ed6c9230783e is going to be created. [ 764.897570] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.897775] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.897936] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.898228] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.898456] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.898675] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-c3c8b29a-f337-4652-9709-ed6c9230783e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.177237] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.177237] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.177237] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.177237] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.177237] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.177237] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.177808] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.177808] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.177808] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.177808] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.177808] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 is going to be updated. [ 765.205441] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.205441] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.205441] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.205667] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.205839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.216293] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 in Status: IN_PROGRESS for 2s [ 765.276100] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 in Status: SUCCESS [ 765.276336] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.570681] env[69559]: INFO networking_nsxv3.common.synchronization [req-e8f11b80-636d-4439-bbc7-c28691ae51b5 req-cf126ea5-a21f-4f35-a693-f9fe103b3636 service nova] Enqueued Resource ID: 734f0202-8a2d-48a6-8b16-336653a0c857 with Priority: HIGHEST for action security_group_rules [ 765.570864] env[69559]: INFO networking_nsxv3.common.synchronization [req-e8f11b80-636d-4439-bbc7-c28691ae51b5 req-cf126ea5-a21f-4f35-a693-f9fe103b3636 service nova] Enqueued Resource ID: 734f0202-8a2d-48a6-8b16-336653a0c857 with Priority: HIGHEST for action security_group_members [ 765.571011] env[69559]: INFO networking_nsxv3.common.synchronization [req-e8f11b80-636d-4439-bbc7-c28691ae51b5 req-cf126ea5-a21f-4f35-a693-f9fe103b3636 service nova] Enqueued Resource ID: c3c8b29a-f337-4652-9709-ed6c9230783e with Priority: HIGHEST for action port [ 765.571257] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 734f0202-8a2d-48a6-8b16-336653a0c857 with Priority: HIGHEST for action security_group_rules [ 765.571382] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 734f0202-8a2d-48a6-8b16-336653a0c857 with Priority: HIGHEST for action security_group_members [ 765.571477] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3c8b29a-f337-4652-9709-ed6c9230783e with Priority: HIGHEST for action port [ 765.572195] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-734f0202-8a2d-48a6-8b16-336653a0c857 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.572284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.572354] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.572595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.572675] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.573909] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-734f0202-8a2d-48a6-8b16-336653a0c857 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.574028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.574102] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.575218] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.575387] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.575506] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.575668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.575979] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.575979] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.575979] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.576689] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3c8b29a-f337-4652-9709-ed6c9230783e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.576796] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3c8b29a-f337-4652-9709-ed6c9230783e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.576855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3c8b29a-f337-4652-9709-ed6c9230783e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.577045] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3c8b29a-f337-4652-9709-ed6c9230783e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.577131] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3c8b29a-f337-4652-9709-ed6c9230783e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.082055] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-734f0202-8a2d-48a6-8b16-336653a0c857 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.082055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.082055] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3c8b29a-f337-4652-9709-ed6c9230783e with status ACTIVE [ 766.082055] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.082055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.082055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.082055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.082055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.082055] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.082055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.082055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.082055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.082055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.082055] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.082961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.082961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.082961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.082961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.082961] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3c8b29a-f337-4652-9709-ed6c9230783e is going to be updated. [ 766.082961] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.105365] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.105365] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.105365] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.105365] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.105365] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.105365] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3c8b29a-f337-4652-9709-ed6c9230783e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.586732] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.733021] env[69559]: INFO networking_nsxv3.common.synchronization [req-b3768821-ceb5-4eff-895d-e4b61f54a92e req-9c62fde4-f3aa-4a8f-a9b7-ea9ca13503d5 tempest-FloatingIPsAssociationTestJSON-1860057914 tempest-FloatingIPsAssociationTestJSON-1860057914-project-member] Enqueued Resource ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 with Priority: HIGHEST for action security_group_members [ 766.733021] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 with Priority: HIGHEST for action security_group_members [ 766.733021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f7f9d2e-64a3-4672-969a-45f64c5621d1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.733021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.733021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.733021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.733021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.733021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.733021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.733537] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.733537] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.733537] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f7f9d2e-64a3-4672-969a-45f64c5621d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.019258] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.019258] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-985" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.019258] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-985" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.019258] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-985" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.019258] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.019258] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.019258] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.019258] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.019258] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.019648] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 767.019648] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.019648] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.019730] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.019925] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 767.019925] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.020049] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.038011] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.038191] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 767.038331] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.038491] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-985" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.038860] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-c13ff072-97e9-4baf-b3e5-180daccd2348 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.038993] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-c13ff072-97e9-4baf-b3e5-180daccd2348" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.039073] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-c13ff072-97e9-4baf-b3e5-180daccd2348" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.039354] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-c13ff072-97e9-4baf-b3e5-180daccd2348" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.039496] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c13ff072-97e9-4baf-b3e5-180daccd2348',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.088966] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.089137] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.089212] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.089409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.089501] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.089596] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 734f0202-8a2d-48a6-8b16-336653a0c857 is going to be created. [ 767.111263] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.111479] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.111540] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.111781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.111941] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.121246] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 734f0202-8a2d-48a6-8b16-336653a0c857 in Status: UNINITIALIZED for 2s [ 767.231045] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 in Status: SUCCESS [ 767.231240] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c225ff1a-79ed-4da1-ac55-3b8ee41f70a5 deletion is rescheduled due to dependency. [ 767.231357] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c225ff1a-79ed-4da1-ac55-3b8ee41f70a5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.235815] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f7f9d2e-64a3-4672-969a-45f64c5621d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.543281] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.543281] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.543281] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.543281] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.543481] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.543569] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port c13ff072-97e9-4baf-b3e5-180daccd2348 not found, creating... [ 767.543829] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.543990] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.544167] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.544618] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.544618] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.544765] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.544891] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.545018] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.545225] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.545368] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.545499] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: c13ff072-97e9-4baf-b3e5-180daccd2348 is going to be created. [ 767.567409] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.567627] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.567753] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.568085] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.568399] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.568634] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-c13ff072-97e9-4baf-b3e5-180daccd2348" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.739277] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f7f9d2e-64a3-4672-969a-45f64c5621d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.240260] env[69559]: INFO networking_nsxv3.common.synchronization [req-b3768821-ceb5-4eff-895d-e4b61f54a92e req-6735666c-83dd-47ed-a7b2-7d74ff2037db service nova] Enqueued Resource ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 with Priority: HIGHEST for action security_group_rules [ 768.240444] env[69559]: INFO networking_nsxv3.common.synchronization [req-b3768821-ceb5-4eff-895d-e4b61f54a92e req-6735666c-83dd-47ed-a7b2-7d74ff2037db service nova] Enqueued Resource ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 with Priority: HIGHEST for action security_group_members [ 768.240585] env[69559]: INFO networking_nsxv3.common.synchronization [req-b3768821-ceb5-4eff-895d-e4b61f54a92e req-6735666c-83dd-47ed-a7b2-7d74ff2037db service nova] Enqueued Resource ID: c13ff072-97e9-4baf-b3e5-180daccd2348 with Priority: HIGHEST for action port [ 768.240818] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 with Priority: HIGHEST for action security_group_rules [ 768.240966] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 with Priority: HIGHEST for action security_group_members [ 768.241155] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c13ff072-97e9-4baf-b3e5-180daccd2348 with Priority: HIGHEST for action port [ 768.241686] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.241846] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.241887] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.243118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.243262] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.243387] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 is going to be updated. [ 768.244641] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f7f9d2e-64a3-4672-969a-45f64c5621d1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.244931] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.248805] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.249116] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.249174] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f7f9d2e-64a3-4672-969a-45f64c5621d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.250559] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f7f9d2e-64a3-4672-969a-45f64c5621d1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.250709] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.250947] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-c13ff072-97e9-4baf-b3e5-180daccd2348 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.251071] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c13ff072-97e9-4baf-b3e5-180daccd2348" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.251183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c13ff072-97e9-4baf-b3e5-180daccd2348" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.251384] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c13ff072-97e9-4baf-b3e5-180daccd2348" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.251989] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c13ff072-97e9-4baf-b3e5-180daccd2348',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.281291] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.281291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.281291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.281291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.281291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.288105] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 in Status: IN_PROGRESS for 2s [ 768.754977] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f7f9d2e-64a3-4672-969a-45f64c5621d1 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.755400] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.755400] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c13ff072-97e9-4baf-b3e5-180daccd2348 with status ACTIVE [ 768.755505] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.755578] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.756039] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.756039] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.756039] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.756245] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.756332] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.756386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.756519] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.756603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.756804] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.756901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.756960] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.757142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.757216] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.757303] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c13ff072-97e9-4baf-b3e5-180daccd2348 is going to be updated. [ 768.776923] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.776923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.776923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.777164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.777988] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.777988] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c13ff072-97e9-4baf-b3e5-180daccd2348" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.130057] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 734f0202-8a2d-48a6-8b16-336653a0c857 in Status: SUCCESS [ 769.130205] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.130497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.130572] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.130760] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.130878] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.130949] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.131153] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.131239] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.131326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.131418] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.634323] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-734f0202-8a2d-48a6-8b16-336653a0c857 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.634465] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.634552] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.634743] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.634950] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.635028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.635063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.635214] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.635302] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.635387] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.635530] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-734f0202-8a2d-48a6-8b16-336653a0c857 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.635641] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.635681] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.635927] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.636091] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.636185] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.636242] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.636386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.636453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.636533] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.636605] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.139345] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 734f0202-8a2d-48a6-8b16-336653a0c857: rpc.has_security_group_logging(os_id): False [ 770.156670] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.156885] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.156885] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.157109] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.157199] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.157446] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.157549] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.157683] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.158020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.158116] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.158319] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.158415] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.158474] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.158617] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.158691] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.158899] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.159060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.159060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.159196] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.159288] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.159372] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 734f0202-8a2d-48a6-8b16-336653a0c857 is going to be created. [ 770.212490] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.212664] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.212724] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.212910] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.213099] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.226388] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 734f0202-8a2d-48a6-8b16-336653a0c857 in Status: IN_PROGRESS for 2s [ 770.297310] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 in Status: SUCCESS [ 770.297520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.297682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.298118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.298193] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.298265] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.298339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.298490] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.298571] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.298664] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f7f9d2e-64a3-4672-969a-45f64c5621d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.801736] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f7f9d2e-64a3-4672-969a-45f64c5621d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.308924] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f7f9d2e-64a3-4672-969a-45f64c5621d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.811853] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.812035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.812111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.812334] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.812429] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.812535] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 is going to be updated. [ 771.838861] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.839134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.839134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.839279] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.839419] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.847482] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 in Status: IN_PROGRESS for 2s [ 772.240889] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 734f0202-8a2d-48a6-8b16-336653a0c857 in Status: SUCCESS [ 772.241216] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.241610] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 773.241956] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 773.859217] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 in Status: SUCCESS [ 773.859217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.859217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.859217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.859467] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.859530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.859619] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.859841] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.859974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.860116] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.860458] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f7f9d2e-64a3-4672-969a-45f64c5621d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.362530] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f7f9d2e-64a3-4672-969a-45f64c5621d1 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.362899] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.362899] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.363056] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.363149] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.363249] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.363300] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.363483] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.363483] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.363620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.363701] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f7f9d2e-64a3-4672-969a-45f64c5621d1 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.363793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.363848] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.363998] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.364225] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.364332] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.364576] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.364810] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.364950] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.365111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.365252] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f7f9d2e-64a3-4672-969a-45f64c5621d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.868391] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f7f9d2e-64a3-4672-969a-45f64c5621d1: rpc.has_security_group_logging(os_id): False [ 774.888677] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.888886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.888886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.889221] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.889301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.889589] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.889697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.889764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.889929] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.890016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.890278] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.890356] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.890415] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.890560] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.890756] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.890952] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.891061] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.891126] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.891265] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.891340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.891426] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 is going to be updated. [ 774.953103] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.953349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.953349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.953666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.953666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.966632] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 in Status: IN_PROGRESS for 2s [ 776.981150] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 in Status: SUCCESS [ 776.981150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.245403] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 778.245707] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 781.661092] env[69559]: INFO networking_nsxv3.common.synchronization [None req-9a4c77f8-08b6-48b2-b765-d525ff5a2990 None None] Enqueued Resource ID: 9315dc2a-8e29-41f6-a523-e41471cb5874 with Priority: HIGHEST for action port [ 781.661653] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9315dc2a-8e29-41f6-a523-e41471cb5874 with Priority: HIGHEST for action port [ 781.661960] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-9315dc2a-8e29-41f6-a523-e41471cb5874 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.662338] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9315dc2a-8e29-41f6-a523-e41471cb5874" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.662603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9315dc2a-8e29-41f6-a523-e41471cb5874" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.662927] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9315dc2a-8e29-41f6-a523-e41471cb5874" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.663077] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9315dc2a-8e29-41f6-a523-e41471cb5874',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.166659] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9315dc2a-8e29-41f6-a523-e41471cb5874 [ 782.166659] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.166659] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.166659] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.166659] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.166659] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.166659] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9315dc2a-8e29-41f6-a523-e41471cb5874 already deleted. [ 782.166659] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9315dc2a-8e29-41f6-a523-e41471cb5874" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.118481] env[69559]: INFO networking_nsxv3.common.synchronization [req-52456d2c-e7a3-4c8b-92f4-5ffd298a9d47 req-8224f656-5e0f-4381-bc96-b31b0ac7a35a tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 783.118955] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 783.119587] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.119587] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.119587] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.119818] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.119818] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.119930] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.119930] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.121610] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.121610] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.121782] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.624139] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.127406] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.146965] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.147292] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-547" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.147946] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-547" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.147946] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-547" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.148994] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.149305] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.149508] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.150212] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.150212] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.150887] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.150963] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 784.151131] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 784.153228] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 784.153228] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.153228] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 784.153228] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 784.177534] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 784.177818] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 784.178093] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 784.178716] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-547" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.178910] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-aed4d3f8-2aac-49ae-9149-5c9c9d62738f taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.179214] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-aed4d3f8-2aac-49ae-9149-5c9c9d62738f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.179433] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-aed4d3f8-2aac-49ae-9149-5c9c9d62738f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.179910] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-aed4d3f8-2aac-49ae-9149-5c9c9d62738f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.180171] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aed4d3f8-2aac-49ae-9149-5c9c9d62738f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.261419] env[69559]: INFO networking_nsxv3.common.synchronization [None req-079f7613-454e-407e-9897-34d45fc0e77f None None] Enqueued Resource ID: eb41133e-250e-4ec8-bdb4-89d3a4519947 with Priority: HIGHEST for action port [ 784.261691] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb41133e-250e-4ec8-bdb4-89d3a4519947 with Priority: HIGHEST for action port [ 784.264769] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb41133e-250e-4ec8-bdb4-89d3a4519947 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.264769] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb41133e-250e-4ec8-bdb4-89d3a4519947" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.264769] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb41133e-250e-4ec8-bdb4-89d3a4519947" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.264769] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb41133e-250e-4ec8-bdb4-89d3a4519947" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.264769] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb41133e-250e-4ec8-bdb4-89d3a4519947',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.636329] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.636329] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.636329] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.636329] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.636329] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.636329] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 is going to be updated. [ 784.668990] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.668990] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.668990] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.668990] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.668990] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.677990] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: IN_PROGRESS for 2s [ 784.685538] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.685538] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.685538] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.685538] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.685538] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.685538] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port aed4d3f8-2aac-49ae-9149-5c9c9d62738f not found, creating... [ 784.685538] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.686163] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.686339] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.687040] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.687040] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.687040] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.687442] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.687442] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.687560] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.687696] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.687728] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: aed4d3f8-2aac-49ae-9149-5c9c9d62738f is going to be created. [ 784.712874] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.713084] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.713207] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.713475] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.713694] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.713911] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-aed4d3f8-2aac-49ae-9149-5c9c9d62738f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.765762] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb41133e-250e-4ec8-bdb4-89d3a4519947 [ 784.766140] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.766278] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.766318] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.766542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.766636] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.766733] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb41133e-250e-4ec8-bdb4-89d3a4519947 already deleted. [ 784.766812] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb41133e-250e-4ec8-bdb4-89d3a4519947" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.254383] env[69559]: INFO networking_nsxv3.common.synchronization [req-d123e3a1-4283-4738-b576-6603fe087e74 req-5b56ac28-1cf9-49ef-a01e-8bab92ba759d tempest-FloatingIPsAssociationTestJSON-1860057914 tempest-FloatingIPsAssociationTestJSON-1860057914-project-member] Enqueued Resource ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 with Priority: HIGHEST for action security_group_members [ 785.254383] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 with Priority: HIGHEST for action security_group_members [ 785.254383] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f7f9d2e-64a3-4672-969a-45f64c5621d1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.254383] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.254383] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.254383] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.254383] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.254383] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.254383] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.256023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.256280] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.256715] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f7f9d2e-64a3-4672-969a-45f64c5621d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.636956] env[69559]: INFO networking_nsxv3.common.synchronization [req-52456d2c-e7a3-4c8b-92f4-5ffd298a9d47 req-9ffe7de8-94b9-4353-8643-bf5af24be95e service nova] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_rules [ 785.637202] env[69559]: INFO networking_nsxv3.common.synchronization [req-52456d2c-e7a3-4c8b-92f4-5ffd298a9d47 req-9ffe7de8-94b9-4353-8643-bf5af24be95e service nova] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 785.637348] env[69559]: INFO networking_nsxv3.common.synchronization [req-52456d2c-e7a3-4c8b-92f4-5ffd298a9d47 req-9ffe7de8-94b9-4353-8643-bf5af24be95e service nova] Enqueued Resource ID: aed4d3f8-2aac-49ae-9149-5c9c9d62738f with Priority: HIGHEST for action port [ 785.637652] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_rules [ 785.637738] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 785.637862] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aed4d3f8-2aac-49ae-9149-5c9c9d62738f with Priority: HIGHEST for action port [ 785.638495] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.638628] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.638701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.638922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.639143] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.642865] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.642865] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.642865] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-aed4d3f8-2aac-49ae-9149-5c9c9d62738f taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.642865] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aed4d3f8-2aac-49ae-9149-5c9c9d62738f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.642865] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aed4d3f8-2aac-49ae-9149-5c9c9d62738f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.642865] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aed4d3f8-2aac-49ae-9149-5c9c9d62738f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.642865] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aed4d3f8-2aac-49ae-9149-5c9c9d62738f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.699022] env[69559]: INFO networking_nsxv3.common.synchronization [req-43ec922a-1549-473f-b61e-637c893ec4e4 req-9479cc86-e4f6-4a84-993c-b8494201ec58 tempest-ServersTestFqdnHostnames-1882326979 tempest-ServersTestFqdnHostnames-1882326979-project-member] Enqueued Resource ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 with Priority: HIGHEST for action security_group_members [ 785.699022] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 with Priority: HIGHEST for action security_group_members [ 785.699467] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2d4f121-303e-4c6b-ac7a-e595df5750d8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.699955] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.700120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.700514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.700798] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.702297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.702297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.702297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.702297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.702297] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2d4f121-303e-4c6b-ac7a-e595df5750d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.760710] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f7f9d2e-64a3-4672-969a-45f64c5621d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.091985] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-930 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.091985] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-930" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.091985] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-930" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.092236] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-930" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.092620] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.092715] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.092788] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.093016] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.093240] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.093490] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 786.093638] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 786.093780] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 786.094113] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 786.094289] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 786.094434] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 786.094808] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 786.116641] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 786.116917] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 786.117173] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 786.117461] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-930" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.117941] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-d956a823-53a7-4221-9cff-c7fcf4ad62ac taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.118253] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-d956a823-53a7-4221-9cff-c7fcf4ad62ac" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.118476] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-d956a823-53a7-4221-9cff-c7fcf4ad62ac" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.118927] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-d956a823-53a7-4221-9cff-c7fcf4ad62ac" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.122077] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d956a823-53a7-4221-9cff-c7fcf4ad62ac',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.143229] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.143883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.146310] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aed4d3f8-2aac-49ae-9149-5c9c9d62738f with status ACTIVE [ 786.146310] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.146310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.146310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.146310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.146310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.146310] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.146310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.146310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.146310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.146310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.146924] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.147172] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.147331] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.147589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.147802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.147971] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aed4d3f8-2aac-49ae-9149-5c9c9d62738f is going to be updated. [ 786.181305] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.181305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.181305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.181305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.181305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.181305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aed4d3f8-2aac-49ae-9149-5c9c9d62738f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.204276] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.204444] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.204519] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.204736] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.204829] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.205045] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.205149] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.205214] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.205362] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.206341] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.206341] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 already deleted. [ 786.206341] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.264579] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f7f9d2e-64a3-4672-969a-45f64c5621d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.627348] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.628541] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.628541] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.629152] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.629440] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.629708] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port d956a823-53a7-4221-9cff-c7fcf4ad62ac not found, creating... [ 786.630452] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.630452] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.630452] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.630669] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.630803] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.632213] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.633087] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.633087] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.633087] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.633220] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.633267] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: d956a823-53a7-4221-9cff-c7fcf4ad62ac is going to be created. [ 786.653428] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.653428] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.653428] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.653618] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.653819] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.657107] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-d956a823-53a7-4221-9cff-c7fcf4ad62ac" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.688479] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: SUCCESS [ 786.689472] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.689472] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.689472] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.689472] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.689472] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.689472] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.689844] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.689844] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.689844] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.767920] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.769853] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.769853] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.769853] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.769853] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.769853] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 is going to be updated. [ 786.816447] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.816580] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.816647] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.816848] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.816982] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.829578] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 in Status: IN_PROGRESS for 2s [ 787.192359] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.531897] env[69559]: INFO networking_nsxv3.common.synchronization [req-43ec922a-1549-473f-b61e-637c893ec4e4 req-0eb19205-3f92-4e1a-899c-99a9ad2f3397 service nova] Enqueued Resource ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 with Priority: HIGHEST for action security_group_rules [ 787.532182] env[69559]: INFO networking_nsxv3.common.synchronization [req-43ec922a-1549-473f-b61e-637c893ec4e4 req-0eb19205-3f92-4e1a-899c-99a9ad2f3397 service nova] Enqueued Resource ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 with Priority: HIGHEST for action security_group_members [ 787.532241] env[69559]: INFO networking_nsxv3.common.synchronization [req-43ec922a-1549-473f-b61e-637c893ec4e4 req-0eb19205-3f92-4e1a-899c-99a9ad2f3397 service nova] Enqueued Resource ID: d956a823-53a7-4221-9cff-c7fcf4ad62ac with Priority: HIGHEST for action port [ 787.532478] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 with Priority: HIGHEST for action security_group_rules [ 787.532604] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 with Priority: HIGHEST for action security_group_members [ 787.532700] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d956a823-53a7-4221-9cff-c7fcf4ad62ac with Priority: HIGHEST for action port [ 787.533369] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2d4f121-303e-4c6b-ac7a-e595df5750d8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.533497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.533567] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.533787] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.533909] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2d4f121-303e-4c6b-ac7a-e595df5750d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.534714] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2d4f121-303e-4c6b-ac7a-e595df5750d8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.534824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.534886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.535069] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.535350] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.535350] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.535471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.535504] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.535581] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.535673] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2d4f121-303e-4c6b-ac7a-e595df5750d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.536736] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-d956a823-53a7-4221-9cff-c7fcf4ad62ac taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.536844] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d956a823-53a7-4221-9cff-c7fcf4ad62ac" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.536911] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d956a823-53a7-4221-9cff-c7fcf4ad62ac" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.537112] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d956a823-53a7-4221-9cff-c7fcf4ad62ac" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.537166] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d956a823-53a7-4221-9cff-c7fcf4ad62ac',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.696202] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.038504] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2d4f121-303e-4c6b-ac7a-e595df5750d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.039730] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2d4f121-303e-4c6b-ac7a-e595df5750d8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.042189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.042189] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d956a823-53a7-4221-9cff-c7fcf4ad62ac with status ACTIVE [ 788.042189] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.042189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.042189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.042189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.042189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.042189] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.042189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.042189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.042189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.042189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.042189] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.042189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.042189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.043825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.044461] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.044461] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d956a823-53a7-4221-9cff-c7fcf4ad62ac is going to be updated. [ 788.072092] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.072092] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.072092] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.072092] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.072092] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.072092] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d956a823-53a7-4221-9cff-c7fcf4ad62ac" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.202645] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.202797] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.202869] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.203093] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.203183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.203293] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 is going to be updated. [ 788.248283] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.248432] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.248500] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.248714] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.248849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.257792] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: IN_PROGRESS for 2s [ 788.542223] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2d4f121-303e-4c6b-ac7a-e595df5750d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.627023] env[69559]: INFO networking_nsxv3.common.synchronization [req-7b13ac83-d87a-40e9-98ad-33adeb9874f5 req-489578e5-8d73-4311-9eb8-c65505655543 tempest-VolumesAdminNegativeTest-1895972689 tempest-VolumesAdminNegativeTest-1895972689-project-member] Enqueued Resource ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e with Priority: HIGHEST for action security_group_members [ 788.627023] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e with Priority: HIGHEST for action security_group_members [ 788.627023] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-acb5a9fe-3650-403a-90f4-19ec52b5f97e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.627023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.627023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.627023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.627559] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.627770] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.627851] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.628082] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.628177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.628329] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acb5a9fe-3650-403a-90f4-19ec52b5f97e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.840519] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 in Status: SUCCESS [ 788.840519] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.048485] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.048485] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.048485] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.048485] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.048485] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.048485] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 is going to be created. [ 789.072583] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.072758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.072826] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.073245] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.073478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.083557] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 in Status: UNINITIALIZED for 2s [ 789.130266] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.130637] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.130729] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.130965] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.131164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.131358] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.131450] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.131484] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.131627] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.131751] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.131798] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e already deleted. [ 789.132038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.187279] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-119 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.187445] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-119" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.187553] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-119" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.187890] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-119" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.188236] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.188402] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.188574] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.188737] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.188911] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.189147] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 789.189288] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 789.189390] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 789.189534] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 789.189658] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 789.189772] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 789.189952] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 789.214269] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 789.214476] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 789.214604] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 789.219443] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-119" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.219995] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-61480e87-906b-4ea3-bc47-a7e757fcdc8d taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.220331] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-61480e87-906b-4ea3-bc47-a7e757fcdc8d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.221034] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-61480e87-906b-4ea3-bc47-a7e757fcdc8d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.221034] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-61480e87-906b-4ea3-bc47-a7e757fcdc8d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.221285] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61480e87-906b-4ea3-bc47-a7e757fcdc8d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.726225] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.726225] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.726628] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.726628] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.726921] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.726921] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 61480e87-906b-4ea3-bc47-a7e757fcdc8d not found, creating... [ 789.727301] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.727423] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.727515] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.727702] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.727842] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.728207] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.728380] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.728500] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.728783] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.728842] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.729212] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 61480e87-906b-4ea3-bc47-a7e757fcdc8d is going to be created. [ 789.749324] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.749572] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.749709] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.750026] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.750455] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.750705] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-61480e87-906b-4ea3-bc47-a7e757fcdc8d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.272453] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: SUCCESS [ 790.272453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.272453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.272453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.272453] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.272453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.272453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.272453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.272453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.272453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.272453] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.522358] env[69559]: INFO networking_nsxv3.common.synchronization [req-7b13ac83-d87a-40e9-98ad-33adeb9874f5 req-47dd17d9-446a-4390-b50d-160151eef72a service nova] Enqueued Resource ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e with Priority: HIGHEST for action security_group_rules [ 790.522433] env[69559]: INFO networking_nsxv3.common.synchronization [req-7b13ac83-d87a-40e9-98ad-33adeb9874f5 req-47dd17d9-446a-4390-b50d-160151eef72a service nova] Enqueued Resource ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e with Priority: HIGHEST for action security_group_members [ 790.522635] env[69559]: INFO networking_nsxv3.common.synchronization [req-7b13ac83-d87a-40e9-98ad-33adeb9874f5 req-47dd17d9-446a-4390-b50d-160151eef72a service nova] Enqueued Resource ID: 61480e87-906b-4ea3-bc47-a7e757fcdc8d with Priority: HIGHEST for action port [ 790.522895] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e with Priority: HIGHEST for action security_group_rules [ 790.523060] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e with Priority: HIGHEST for action security_group_members [ 790.523198] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61480e87-906b-4ea3-bc47-a7e757fcdc8d with Priority: HIGHEST for action port [ 790.523826] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.524368] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.524368] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.524368] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.524368] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acb5a9fe-3650-403a-90f4-19ec52b5f97e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.525819] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-acb5a9fe-3650-403a-90f4-19ec52b5f97e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.525819] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.525819] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.525819] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.525819] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.526093] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.526093] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.526195] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.526743] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.526743] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acb5a9fe-3650-403a-90f4-19ec52b5f97e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.529935] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-61480e87-906b-4ea3-bc47-a7e757fcdc8d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.529935] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61480e87-906b-4ea3-bc47-a7e757fcdc8d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.529935] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61480e87-906b-4ea3-bc47-a7e757fcdc8d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.529935] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61480e87-906b-4ea3-bc47-a7e757fcdc8d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.529935] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61480e87-906b-4ea3-bc47-a7e757fcdc8d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.774742] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.775060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.775060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.775187] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.775348] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.775441] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.775503] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.775639] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.775723] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.775806] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.776023] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.776078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.776123] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.776507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.776507] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.776507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.776507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.776692] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.776767] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.776800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.776964] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.030798] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-acb5a9fe-3650-403a-90f4-19ec52b5f97e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.030945] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.031140] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('acb5a9fe-3650-403a-90f4-19ec52b5f97e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.031997] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61480e87-906b-4ea3-bc47-a7e757fcdc8d with status ACTIVE [ 791.032196] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.032309] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.032374] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.032573] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.032660] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.032827] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.032923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.032980] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.033241] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.033324] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.033507] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.033600] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.033657] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.033801] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.034400] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.034400] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61480e87-906b-4ea3-bc47-a7e757fcdc8d is going to be updated. [ 791.053739] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.053898] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.053942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.054156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.054288] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.054445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61480e87-906b-4ea3-bc47-a7e757fcdc8d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.095759] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 in Status: SUCCESS [ 791.096067] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.096247] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.096458] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.096652] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.096769] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.096833] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.096980] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.097072] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.097157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.097275] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2d4f121-303e-4c6b-ac7a-e595df5750d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.279050] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 392028d0-93e9-4420-8ca7-d3fa218b5c83: rpc.has_security_group_logging(os_id): False [ 791.301258] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.301419] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.301491] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.301698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.301795] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.302014] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.302139] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.302213] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.302361] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.302435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.302608] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.302736] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.302736] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.302874] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.302946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.303187] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.303422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.303422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.303546] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.303593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.303637] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 is going to be updated. [ 791.369296] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.370873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.370873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.370873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.370873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.383036] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: IN_PROGRESS for 2s [ 791.535882] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('acb5a9fe-3650-403a-90f4-19ec52b5f97e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.599790] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2d4f121-303e-4c6b-ac7a-e595df5750d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.851156] env[69559]: INFO networking_nsxv3.common.synchronization [req-36791ed6-80a7-48c2-b729-2c2d3aaa3794 req-86d48bf9-f110-4709-aaa6-fa294ae96280 tempest-ServerActionsTestOtherA-1414477814 tempest-ServerActionsTestOtherA-1414477814-project-member] Enqueued Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGHEST for action security_group_members [ 791.852625] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGHEST for action security_group_members [ 791.852968] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-531bc278-c746-4ada-9fc4-704b99519eae taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.853089] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.853157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.853395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.853550] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.853683] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.853744] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.853870] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.853921] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.854119] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.038248] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.038480] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.038610] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.038815] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.038929] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.039064] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e is going to be created. [ 792.065342] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.065446] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.065529] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.069018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.069018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.075289] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e in Status: UNINITIALIZED for 2s [ 792.104034] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2d4f121-303e-4c6b-ac7a-e595df5750d8: rpc.has_security_group_logging(os_id): False [ 792.124889] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.125073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.125139] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.125331] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.125431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.125775] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.127373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.127373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.127373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.127373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.127373] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 is going to be created. [ 792.216203] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.216392] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.216465] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.216687] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.216870] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.232932] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 in Status: IN_PROGRESS for 2s [ 792.360946] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.361122] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.361192] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.361404] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.361491] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.361687] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.361780] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.361839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.361981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.362066] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.364499] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 531bc278-c746-4ada-9fc4-704b99519eae already deleted. [ 792.364499] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.403639] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-964 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.403846] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.403994] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.404473] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.404780] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.405825] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.406151] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.407527] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.407697] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.407916] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 792.408067] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 792.408211] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 792.408331] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 792.408450] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 792.408559] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 792.408708] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 792.428662] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 792.428925] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 792.429124] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 792.429355] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.430012] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-b743109b-7cd0-44fa-801b-45fc6526fdba taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.430012] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-b743109b-7cd0-44fa-801b-45fc6526fdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.430012] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-b743109b-7cd0-44fa-801b-45fc6526fdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.432345] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-b743109b-7cd0-44fa-801b-45fc6526fdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.432495] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b743109b-7cd0-44fa-801b-45fc6526fdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.935447] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.935777] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.935821] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.936087] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.936245] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.936400] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port b743109b-7cd0-44fa-801b-45fc6526fdba not found, creating... [ 792.936665] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.936820] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.936937] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.937169] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.937304] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.937581] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.937813] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.937862] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.939917] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.940173] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.940466] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: b743109b-7cd0-44fa-801b-45fc6526fdba is going to be created. [ 792.964578] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.964707] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.964835] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.965128] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.965357] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.965575] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-b743109b-7cd0-44fa-801b-45fc6526fdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.398714] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: SUCCESS [ 793.398946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.742408] env[69559]: INFO networking_nsxv3.common.synchronization [req-76d6178a-bbbe-41e0-b817-bb866796f701 req-f417381c-20cd-4fe0-9873-43f01becb09e tempest-ListImageFiltersTestJSON-342177122 tempest-ListImageFiltersTestJSON-342177122-project-member] Enqueued Resource ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 with Priority: HIGHEST for action security_group_members [ 793.743175] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 with Priority: HIGHEST for action security_group_members [ 793.743554] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.743782] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.743904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.744162] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.744299] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.744407] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.744471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.744644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.744731] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.744829] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d3ab8f7-3874-4370-9e84-4a90ecd908d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.838731] env[69559]: INFO networking_nsxv3.common.synchronization [req-37c1f45b-a961-47ab-ad69-00cad1e1e73b req-58852e44-3053-4de7-a590-420341b0f030 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 793.838878] env[69559]: INFO networking_nsxv3.common.synchronization [req-37c1f45b-a961-47ab-ad69-00cad1e1e73b req-58852e44-3053-4de7-a590-420341b0f030 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: a4e0cfba-8016-40f3-90aa-98a94645d23c with Priority: HIGHEST for action security_group_members [ 793.841508] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 793.841739] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4e0cfba-8016-40f3-90aa-98a94645d23c with Priority: HIGHEST for action security_group_members [ 793.842709] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.842709] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.842709] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.842955] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.843138] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.843241] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.843301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.843544] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.843544] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.843655] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.844546] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4e0cfba-8016-40f3-90aa-98a94645d23c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.844689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.847112] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.847112] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.853023] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.853023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.853023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.853023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.853023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.853023] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4e0cfba-8016-40f3-90aa-98a94645d23c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.027718] env[69559]: INFO networking_nsxv3.common.synchronization [req-37c1f45b-a961-47ab-ad69-00cad1e1e73b req-58852e44-3053-4de7-a590-420341b0f030 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_rules [ 794.028173] env[69559]: INFO networking_nsxv3.common.synchronization [req-37c1f45b-a961-47ab-ad69-00cad1e1e73b req-58852e44-3053-4de7-a590-420341b0f030 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 794.028282] env[69559]: INFO networking_nsxv3.common.synchronization [req-37c1f45b-a961-47ab-ad69-00cad1e1e73b req-58852e44-3053-4de7-a590-420341b0f030 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: a4e0cfba-8016-40f3-90aa-98a94645d23c with Priority: HIGHEST for action security_group_rules [ 794.028491] env[69559]: INFO networking_nsxv3.common.synchronization [req-37c1f45b-a961-47ab-ad69-00cad1e1e73b req-58852e44-3053-4de7-a590-420341b0f030 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: a4e0cfba-8016-40f3-90aa-98a94645d23c with Priority: HIGHEST for action security_group_members [ 794.028707] env[69559]: INFO networking_nsxv3.common.synchronization [req-37c1f45b-a961-47ab-ad69-00cad1e1e73b req-58852e44-3053-4de7-a590-420341b0f030 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: aed4d3f8-2aac-49ae-9149-5c9c9d62738f with Priority: HIGHEST for action port [ 794.029461] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_rules [ 794.029654] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4e0cfba-8016-40f3-90aa-98a94645d23c with Priority: HIGHEST for action security_group_rules [ 794.029830] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aed4d3f8-2aac-49ae-9149-5c9c9d62738f with Priority: HIGHEST for action port [ 794.029994] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 794.030166] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4e0cfba-8016-40f3-90aa-98a94645d23c with Priority: HIGHEST for action security_group_members [ 794.030809] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.030978] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.031112] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.031376] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.031502] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.032385] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4e0cfba-8016-40f3-90aa-98a94645d23c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.032561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.032663] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.032931] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.033060] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4e0cfba-8016-40f3-90aa-98a94645d23c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.033819] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-aed4d3f8-2aac-49ae-9149-5c9c9d62738f taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.033962] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aed4d3f8-2aac-49ae-9149-5c9c9d62738f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.034081] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aed4d3f8-2aac-49ae-9149-5c9c9d62738f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.034302] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aed4d3f8-2aac-49ae-9149-5c9c9d62738f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.034410] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aed4d3f8-2aac-49ae-9149-5c9c9d62738f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.035154] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.035308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.035564] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4e0cfba-8016-40f3-90aa-98a94645d23c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.035874] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.092787] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e in Status: SUCCESS [ 794.092787] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.092787] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.093153] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.093364] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.093530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.093530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.093735] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.093852] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.093970] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.094075] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('acb5a9fe-3650-403a-90f4-19ec52b5f97e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.246591] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 in Status: SUCCESS [ 794.246832] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.247187] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.247337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.247408] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.247581] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.247669] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.247847] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.247938] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.247995] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.248219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.248308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.248406] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 is going to be updated. [ 794.274562] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.274717] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.274784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.274957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.275120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.285613] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 in Status: IN_PROGRESS for 2s [ 794.318377] env[69559]: INFO networking_nsxv3.common.synchronization [req-36791ed6-80a7-48c2-b729-2c2d3aaa3794 req-04d70b0f-bc17-49fd-99a7-57f065804e2c service nova] Enqueued Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGHEST for action security_group_rules [ 794.319027] env[69559]: INFO networking_nsxv3.common.synchronization [req-36791ed6-80a7-48c2-b729-2c2d3aaa3794 req-04d70b0f-bc17-49fd-99a7-57f065804e2c service nova] Enqueued Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGHEST for action security_group_members [ 794.319027] env[69559]: INFO networking_nsxv3.common.synchronization [req-36791ed6-80a7-48c2-b729-2c2d3aaa3794 req-04d70b0f-bc17-49fd-99a7-57f065804e2c service nova] Enqueued Resource ID: b743109b-7cd0-44fa-801b-45fc6526fdba with Priority: HIGHEST for action port [ 794.319241] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGHEST for action security_group_rules [ 794.319404] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGHEST for action security_group_members [ 794.319505] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b743109b-7cd0-44fa-801b-45fc6526fdba with Priority: HIGHEST for action port [ 794.319783] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-531bc278-c746-4ada-9fc4-704b99519eae taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.319907] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.319972] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.320766] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.320766] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.321601] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-531bc278-c746-4ada-9fc4-704b99519eae taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.321718] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.321821] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.321942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.322100] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.322195] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.322258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.322398] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.322482] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.322565] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.326052] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-b743109b-7cd0-44fa-801b-45fc6526fdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.326052] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b743109b-7cd0-44fa-801b-45fc6526fdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.326052] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b743109b-7cd0-44fa-801b-45fc6526fdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.326052] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b743109b-7cd0-44fa-801b-45fc6526fdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.326052] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b743109b-7cd0-44fa-801b-45fc6526fdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.352242] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.355078] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4e0cfba-8016-40f3-90aa-98a94645d23c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.536695] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4e0cfba-8016-40f3-90aa-98a94645d23c taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.537020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.540472] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.540682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.541188] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aed4d3f8-2aac-49ae-9149-5c9c9d62738f with status ACTIVE [ 794.541188] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.541339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.541384] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.541626] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.541755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.541978] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.542130] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.542223] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.542436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.542561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.543239] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.543239] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.543239] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.543239] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.543458] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.543458] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aed4d3f8-2aac-49ae-9149-5c9c9d62738f is going to be updated. [ 794.563361] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.563510] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.563581] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.563790] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.563924] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.564108] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aed4d3f8-2aac-49ae-9149-5c9c9d62738f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.597584] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('acb5a9fe-3650-403a-90f4-19ec52b5f97e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.831618] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.833027] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-531bc278-c746-4ada-9fc4-704b99519eae taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.833361] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.833457] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b743109b-7cd0-44fa-801b-45fc6526fdba with status ACTIVE [ 794.833695] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.833858] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.833951] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.834236] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.834342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.838164] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.838164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.838164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.838164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.838164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.838164] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.838164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.838164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.838164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.838164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.838164] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b743109b-7cd0-44fa-801b-45fc6526fdba is going to be updated. [ 794.855199] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.857237] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4e0cfba-8016-40f3-90aa-98a94645d23c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.868842] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.868842] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.868842] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.868842] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.868842] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.868842] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b743109b-7cd0-44fa-801b-45fc6526fdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.102299] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for acb5a9fe-3650-403a-90f4-19ec52b5f97e: rpc.has_security_group_logging(os_id): False [ 795.122176] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.122365] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.122443] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.122698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.122816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.124595] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.124595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.124595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.124595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.124595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.124595] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e is going to be created. [ 795.214597] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.214799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.215149] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.215149] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.215300] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.233769] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e in Status: IN_PROGRESS for 2s [ 795.280615] env[69559]: INFO networking_nsxv3.common.synchronization [req-df52ff29-1cf1-4f5e-8442-f893f424bc98 req-a0640850-f0da-4efe-8545-a8e4f95b1e5a tempest-ServersAdminNegativeTestJSON-256921676 tempest-ServersAdminNegativeTestJSON-256921676-project-member] Enqueued Resource ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe with Priority: HIGHEST for action security_group_members [ 795.281027] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe with Priority: HIGHEST for action security_group_members [ 795.281322] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6bb8723-4212-49f6-9e0f-6762cf861cbe taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.281443] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.281504] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.281696] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.281848] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.281944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.282118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.282976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.282976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.282976] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6bb8723-4212-49f6-9e0f-6762cf861cbe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.341103] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.362902] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.366245] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.366245] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.366245] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.366245] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.366245] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 is going to be updated. [ 795.371373] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.371373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.371373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.371373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.371373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.371373] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4e0cfba-8016-40f3-90aa-98a94645d23c is going to be created. [ 795.392823] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.392968] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.392968] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.393167] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.393801] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.397940] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.398067] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.398143] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.398336] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.398457] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.403076] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4e0cfba-8016-40f3-90aa-98a94645d23c in Status: UNINITIALIZED for 2s [ 795.405095] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: IN_PROGRESS for 2s [ 795.786407] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.786595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.786674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.787744] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.787744] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.788934] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.789061] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.789133] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.789339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.789441] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.789548] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe is going to be updated. [ 795.820674] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.820674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.820674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.820942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.820942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.829399] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe in Status: IN_PROGRESS for 2s [ 795.842996] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.843171] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.843240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.843446] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.843531] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.843618] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 531bc278-c746-4ada-9fc4-704b99519eae is going to be created. [ 795.867538] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.867723] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.867798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.868012] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.868184] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.884224] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531bc278-c746-4ada-9fc4-704b99519eae in Status: UNINITIALIZED for 2s [ 796.281651] env[69559]: INFO networking_nsxv3.common.synchronization [req-0b80bc20-7a5c-4467-9a61-d1c12dfbf34d req-f18b6216-1bae-44cf-abbe-1c0ccc8b7aa5 tempest-ServerGroupTestJSON-927310883 tempest-ServerGroupTestJSON-927310883-project-member] Enqueued Resource ID: 73004faf-0413-4eab-8656-b74e62d17245 with Priority: HIGHEST for action security_group_members [ 796.286020] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73004faf-0413-4eab-8656-b74e62d17245 with Priority: HIGHEST for action security_group_members [ 796.286020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-73004faf-0413-4eab-8656-b74e62d17245 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.286020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.286020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.286020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.286020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.286020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.286020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.286020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.286020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.286020] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73004faf-0413-4eab-8656-b74e62d17245',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.298416] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 in Status: SUCCESS [ 796.298629] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d3ab8f7-3874-4370-9e84-4a90ecd908d1 deletion is rescheduled due to dependency. [ 796.298898] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d3ab8f7-3874-4370-9e84-4a90ecd908d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.786151] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-296 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.786339] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-296" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.786462] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-296" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.786776] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-296" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.787054] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.787213] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.787331] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.787544] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.787688] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.787894] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.788019] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.788193] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.788284] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.788370] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.788473] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.788607] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.790511] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.790643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.790696] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.790836] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.790920] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.791106] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.791202] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.791263] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.791403] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.791478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.791559] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73004faf-0413-4eab-8656-b74e62d17245 already deleted. [ 796.791635] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.806720] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.806895] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 796.807578] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.807939] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-296" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.808044] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-80b87260-f631-480b-b65b-e6a702caff8c taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.808239] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-80b87260-f631-480b-b65b-e6a702caff8c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.808369] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-80b87260-f631-480b-b65b-e6a702caff8c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.808643] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-80b87260-f631-480b-b65b-e6a702caff8c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.808784] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80b87260-f631-480b-b65b-e6a702caff8c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.252058] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e in Status: SUCCESS [ 797.252313] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.311558] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.315208] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.315434] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.316067] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.316153] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.316333] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 80b87260-f631-480b-b65b-e6a702caff8c not found, creating... [ 797.318081] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.318081] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.318081] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.318081] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.318081] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.318522] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.318580] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.318843] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.319226] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.319453] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.320369] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 80b87260-f631-480b-b65b-e6a702caff8c is going to be created. [ 797.347316] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.347316] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.347316] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.347316] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.347316] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.347316] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-80b87260-f631-480b-b65b-e6a702caff8c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.417423] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: SUCCESS [ 797.417915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.418200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.418717] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.418717] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.419684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.419841] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.419930] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.420033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.420135] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.422685] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4e0cfba-8016-40f3-90aa-98a94645d23c in Status: SUCCESS [ 797.422926] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.423298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.423369] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.423699] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.423699] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.423823] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.423991] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.424132] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.424262] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4e0cfba-8016-40f3-90aa-98a94645d23c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.839800] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe in Status: SUCCESS [ 797.841297] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe deletion is rescheduled due to dependency. [ 797.841429] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.848532] env[69559]: INFO networking_nsxv3.common.synchronization [req-d16a1965-bbbc-4d7d-a141-a64920aa4986 req-87120689-f5c3-4e3c-af10-d30b198d98db tempest-ServersAdminTestJSON-1923717545 tempest-ServersAdminTestJSON-1923717545-project-member] Enqueued Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 797.849135] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 797.849377] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.849516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.849585] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.849781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.849937] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.850393] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.850393] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.850393] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.850393] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.850590] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.894022] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531bc278-c746-4ada-9fc4-704b99519eae in Status: SUCCESS [ 797.894022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.894022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.894022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.894022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.894347] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.894347] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.894347] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.894502] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.894502] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.894588] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.926368] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.931572] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4e0cfba-8016-40f3-90aa-98a94645d23c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.296288] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.296574] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-517" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.296733] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-517" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.297948] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-517" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.299095] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.299095] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.299875] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.300307] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.300546] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.300976] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.301159] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 798.301528] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 798.301851] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 798.302009] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.302211] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 798.302867] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 798.326463] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.326795] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 798.326850] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.326986] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-517" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.327349] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-b5a53680-a489-448c-ae0d-c42deb1d7eb7 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.327532] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-b5a53680-a489-448c-ae0d-c42deb1d7eb7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.327656] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-b5a53680-a489-448c-ae0d-c42deb1d7eb7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.328073] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-b5a53680-a489-448c-ae0d-c42deb1d7eb7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.328288] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5a53680-a489-448c-ae0d-c42deb1d7eb7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.353947] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.396835] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.433220] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.437257] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4e0cfba-8016-40f3-90aa-98a94645d23c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.734912] env[69559]: INFO networking_nsxv3.common.synchronization [req-0b80bc20-7a5c-4467-9a61-d1c12dfbf34d req-1facf485-e48a-465b-bd49-9fb2739ac54e service nova] Enqueued Resource ID: 73004faf-0413-4eab-8656-b74e62d17245 with Priority: HIGHEST for action security_group_rules [ 798.737524] env[69559]: INFO networking_nsxv3.common.synchronization [req-0b80bc20-7a5c-4467-9a61-d1c12dfbf34d req-1facf485-e48a-465b-bd49-9fb2739ac54e service nova] Enqueued Resource ID: 73004faf-0413-4eab-8656-b74e62d17245 with Priority: HIGHEST for action security_group_members [ 798.737782] env[69559]: INFO networking_nsxv3.common.synchronization [req-0b80bc20-7a5c-4467-9a61-d1c12dfbf34d req-1facf485-e48a-465b-bd49-9fb2739ac54e service nova] Enqueued Resource ID: 80b87260-f631-480b-b65b-e6a702caff8c with Priority: HIGHEST for action port [ 798.738422] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73004faf-0413-4eab-8656-b74e62d17245 with Priority: HIGHEST for action security_group_rules [ 798.738566] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73004faf-0413-4eab-8656-b74e62d17245 with Priority: HIGHEST for action security_group_members [ 798.738662] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80b87260-f631-480b-b65b-e6a702caff8c with Priority: HIGHEST for action port [ 798.740212] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73004faf-0413-4eab-8656-b74e62d17245 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.740698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.740698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.740698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.740878] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73004faf-0413-4eab-8656-b74e62d17245',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.741728] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-73004faf-0413-4eab-8656-b74e62d17245 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.743911] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.743911] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.743911] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.743911] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.743911] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.743911] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.743911] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.744234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.744234] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73004faf-0413-4eab-8656-b74e62d17245',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.745360] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-80b87260-f631-480b-b65b-e6a702caff8c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.745468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80b87260-f631-480b-b65b-e6a702caff8c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.745533] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80b87260-f631-480b-b65b-e6a702caff8c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.745693] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80b87260-f631-480b-b65b-e6a702caff8c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.745768] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80b87260-f631-480b-b65b-e6a702caff8c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.832151] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.832389] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.832525] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.832806] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.832963] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.833138] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port b5a53680-a489-448c-ae0d-c42deb1d7eb7 not found, creating... [ 798.833404] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.833561] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.833680] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.833898] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.834045] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.834335] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.834491] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.834610] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.834814] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.834949] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.835228] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: b5a53680-a489-448c-ae0d-c42deb1d7eb7 is going to be created. [ 798.856101] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.863532] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.863532] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.863532] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.863532] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.863532] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.863532] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-b5a53680-a489-448c-ae0d-c42deb1d7eb7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.903612] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 531bc278-c746-4ada-9fc4-704b99519eae: rpc.has_security_group_logging(os_id): False [ 798.924031] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.924031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.924031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.924031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.924031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.924031] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.924031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.924031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.924031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.924031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.924031] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 531bc278-c746-4ada-9fc4-704b99519eae is going to be created. [ 798.934825] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.937802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.937802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.937802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.937802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.937802] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 is going to be updated. [ 798.941280] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.941280] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.941280] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.941280] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.941280] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.941280] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4e0cfba-8016-40f3-90aa-98a94645d23c is going to be updated. [ 798.991721] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.991721] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.991721] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.991721] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.991721] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.007479] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: IN_PROGRESS for 2s [ 799.011042] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.011042] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.011042] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.011042] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.011042] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.033673] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4e0cfba-8016-40f3-90aa-98a94645d23c in Status: IN_PROGRESS for 2s [ 799.056589] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.056742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.056813] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.057061] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.057348] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.070643] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 531bc278-c746-4ada-9fc4-704b99519eae in Status: IN_PROGRESS for 2s [ 799.247686] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-73004faf-0413-4eab-8656-b74e62d17245 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.247686] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.248191] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73004faf-0413-4eab-8656-b74e62d17245',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.250529] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 80b87260-f631-480b-b65b-e6a702caff8c with status ACTIVE [ 799.250786] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.250950] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.252498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.252498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.252498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.252498] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.252498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.252498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.252498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.252498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.252498] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.252498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.252498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.252498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.252498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.253012] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 80b87260-f631-480b-b65b-e6a702caff8c is going to be updated. [ 799.278914] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.279071] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.279167] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.279642] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.279642] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.279800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80b87260-f631-480b-b65b-e6a702caff8c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.359648] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.359648] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.360487] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.360487] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.360487] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.360487] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fab5e96-3f01-4c71-994f-69059ca62986 is going to be updated. [ 799.390956] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.391278] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.391362] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.391586] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.391730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.425120] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: IN_PROGRESS for 2s [ 799.750845] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73004faf-0413-4eab-8656-b74e62d17245',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.780566] env[69559]: INFO networking_nsxv3.common.synchronization [req-d16a1965-bbbc-4d7d-a141-a64920aa4986 req-572e8b68-3750-4eaa-b938-562d9c427aad service nova] Enqueued Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_rules [ 799.780822] env[69559]: INFO networking_nsxv3.common.synchronization [req-d16a1965-bbbc-4d7d-a141-a64920aa4986 req-572e8b68-3750-4eaa-b938-562d9c427aad service nova] Enqueued Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 799.780994] env[69559]: INFO networking_nsxv3.common.synchronization [req-d16a1965-bbbc-4d7d-a141-a64920aa4986 req-572e8b68-3750-4eaa-b938-562d9c427aad service nova] Enqueued Resource ID: b5a53680-a489-448c-ae0d-c42deb1d7eb7 with Priority: HIGHEST for action port [ 799.781526] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_rules [ 799.781683] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 799.781809] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5a53680-a489-448c-ae0d-c42deb1d7eb7 with Priority: HIGHEST for action port [ 799.782428] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.782428] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.782567] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.783957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.783957] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.785957] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.785957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.785957] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5a53680-a489-448c-ae0d-c42deb1d7eb7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.785957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5a53680-a489-448c-ae0d-c42deb1d7eb7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.786143] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5a53680-a489-448c-ae0d-c42deb1d7eb7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.786883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5a53680-a489-448c-ae0d-c42deb1d7eb7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.786883] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5a53680-a489-448c-ae0d-c42deb1d7eb7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.255395] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.255606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.255684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.255932] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.256048] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.256149] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73004faf-0413-4eab-8656-b74e62d17245 is going to be created. [ 800.285702] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.285702] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.285702] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.285702] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.285702] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.293500] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.293500] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.293500] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5a53680-a489-448c-ae0d-c42deb1d7eb7 with status ACTIVE [ 800.293500] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.293500] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.293500] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.293932] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.293932] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.293932] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.294061] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.294135] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.294309] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.294400] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.294801] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.294801] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.294801] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.295099] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.295099] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.295188] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5a53680-a489-448c-ae0d-c42deb1d7eb7 is going to be updated. [ 800.300663] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73004faf-0413-4eab-8656-b74e62d17245 in Status: UNINITIALIZED for 2s [ 800.321318] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.321467] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.321536] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.321755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.321905] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.323011] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5a53680-a489-448c-ae0d-c42deb1d7eb7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.689249] env[69559]: INFO networking_nsxv3.common.synchronization [req-53b4707b-30ac-454c-8268-b8f7d9cafb92 req-6b00fd4b-a0da-4b49-bdcd-dc021894e07f tempest-ServersNegativeTestMultiTenantJSON-204731643 tempest-ServersNegativeTestMultiTenantJSON-204731643-project-member] Enqueued Resource ID: e657c0bf-1532-4777-b875-72ff585a9315 with Priority: HIGHEST for action security_group_members [ 800.690183] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e657c0bf-1532-4777-b875-72ff585a9315 with Priority: HIGHEST for action security_group_members [ 800.690444] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e657c0bf-1532-4777-b875-72ff585a9315 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.690577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.690667] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.690984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.691439] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.691439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.691439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.691439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.691713] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.691713] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e657c0bf-1532-4777-b875-72ff585a9315',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.018940] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: SUCCESS [ 801.019170] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.019365] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.019582] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.019780] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.019900] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.019965] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.020135] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.020220] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.020306] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.020394] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.042550] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4e0cfba-8016-40f3-90aa-98a94645d23c in Status: SUCCESS [ 801.042791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.042943] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.043178] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.043381] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.043498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.043563] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.043716] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.043797] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.043882] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.043970] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4e0cfba-8016-40f3-90aa-98a94645d23c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.082055] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 531bc278-c746-4ada-9fc4-704b99519eae in Status: SUCCESS [ 801.082536] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.197168] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.197332] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.197498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.197635] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.197731] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.197929] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.198206] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.198206] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.198397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.198519] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.198581] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e657c0bf-1532-4777-b875-72ff585a9315 already deleted. [ 801.198672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.439681] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: SUCCESS [ 801.439905] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.440086] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.442034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.442034] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.442034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.442034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.442034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.442034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.442034] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.487441] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-749 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.487862] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-749" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.488116] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-749" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.488619] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-749" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.489051] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.489365] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.489594] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.489973] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.490247] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.490577] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.490783] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 801.490997] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 801.491303] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 801.491454] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 801.491669] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 801.491912] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 801.512098] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 801.512510] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 801.512676] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 801.512964] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-749" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.513732] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-05724813-8a2b-49a4-af52-46b221530f15 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.513865] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-05724813-8a2b-49a4-af52-46b221530f15" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.514008] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-05724813-8a2b-49a4-af52-46b221530f15" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.518476] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-05724813-8a2b-49a4-af52-46b221530f15" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.518739] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05724813-8a2b-49a4-af52-46b221530f15',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.527138] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.527372] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.527372] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.527593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.527761] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.527880] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.527943] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.528132] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.528291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.528348] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.528485] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.528579] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.528650] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.529017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.529017] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.529017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.529335] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.529335] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.529335] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.529451] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.529451] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.534205] env[69559]: INFO networking_nsxv3.common.synchronization [req-987a8b2c-4307-42c5-ad90-7972c1ebcd73 req-d57f06b8-937d-4d87-b9ec-f8f8573106e4 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 801.534205] env[69559]: INFO networking_nsxv3.common.synchronization [req-987a8b2c-4307-42c5-ad90-7972c1ebcd73 req-d57f06b8-937d-4d87-b9ec-f8f8573106e4 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 9eaf11d0-f76c-4a3a-8018-ecc411f189d4 with Priority: HIGHEST for action security_group_members [ 801.534205] env[69559]: INFO networking_nsxv3.common.synchronization [req-987a8b2c-4307-42c5-ad90-7972c1ebcd73 req-d57f06b8-937d-4d87-b9ec-f8f8573106e4 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: a4e0cfba-8016-40f3-90aa-98a94645d23c with Priority: HIGHEST for action security_group_members [ 801.534205] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 801.534205] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eaf11d0-f76c-4a3a-8018-ecc411f189d4 with Priority: HIGHEST for action security_group_members [ 801.534205] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4e0cfba-8016-40f3-90aa-98a94645d23c with Priority: HIGHEST for action security_group_members [ 801.534205] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.534205] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.534205] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.534205] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.534612] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.534612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.534612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.534719] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.534719] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.534782] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.535793] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eaf11d0-f76c-4a3a-8018-ecc411f189d4 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.535920] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eaf11d0-f76c-4a3a-8018-ecc411f189d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.535968] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eaf11d0-f76c-4a3a-8018-ecc411f189d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.539594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eaf11d0-f76c-4a3a-8018-ecc411f189d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.539594] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.539594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.539594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.539594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.539594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.539594] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9eaf11d0-f76c-4a3a-8018-ecc411f189d4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.539594] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4e0cfba-8016-40f3-90aa-98a94645d23c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.539594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.539594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.539594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.539594] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.539594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.539594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.539594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.539594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.539594] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4e0cfba-8016-40f3-90aa-98a94645d23c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.545815] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4e0cfba-8016-40f3-90aa-98a94645d23c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.631455] env[69559]: INFO networking_nsxv3.common.synchronization [req-987a8b2c-4307-42c5-ad90-7972c1ebcd73 req-d57f06b8-937d-4d87-b9ec-f8f8573106e4 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_rules [ 801.631537] env[69559]: INFO networking_nsxv3.common.synchronization [req-987a8b2c-4307-42c5-ad90-7972c1ebcd73 req-d57f06b8-937d-4d87-b9ec-f8f8573106e4 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 801.631675] env[69559]: INFO networking_nsxv3.common.synchronization [req-987a8b2c-4307-42c5-ad90-7972c1ebcd73 req-d57f06b8-937d-4d87-b9ec-f8f8573106e4 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 9eaf11d0-f76c-4a3a-8018-ecc411f189d4 with Priority: HIGHEST for action security_group_rules [ 801.631809] env[69559]: INFO networking_nsxv3.common.synchronization [req-987a8b2c-4307-42c5-ad90-7972c1ebcd73 req-d57f06b8-937d-4d87-b9ec-f8f8573106e4 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 9eaf11d0-f76c-4a3a-8018-ecc411f189d4 with Priority: HIGHEST for action security_group_members [ 801.631985] env[69559]: INFO networking_nsxv3.common.synchronization [req-987a8b2c-4307-42c5-ad90-7972c1ebcd73 req-d57f06b8-937d-4d87-b9ec-f8f8573106e4 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: a4e0cfba-8016-40f3-90aa-98a94645d23c with Priority: HIGHEST for action security_group_rules [ 801.632323] env[69559]: INFO networking_nsxv3.common.synchronization [req-987a8b2c-4307-42c5-ad90-7972c1ebcd73 req-d57f06b8-937d-4d87-b9ec-f8f8573106e4 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: a4e0cfba-8016-40f3-90aa-98a94645d23c with Priority: HIGHEST for action security_group_members [ 801.632543] env[69559]: INFO networking_nsxv3.common.synchronization [req-987a8b2c-4307-42c5-ad90-7972c1ebcd73 req-d57f06b8-937d-4d87-b9ec-f8f8573106e4 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: aed4d3f8-2aac-49ae-9149-5c9c9d62738f with Priority: HIGHEST for action port [ 801.636308] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_rules [ 801.636536] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eaf11d0-f76c-4a3a-8018-ecc411f189d4 with Priority: HIGHEST for action security_group_rules [ 801.636681] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4e0cfba-8016-40f3-90aa-98a94645d23c with Priority: HIGHEST for action security_group_members [ 801.636798] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aed4d3f8-2aac-49ae-9149-5c9c9d62738f with Priority: HIGHEST for action port [ 801.636884] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4e0cfba-8016-40f3-90aa-98a94645d23c with Priority: HIGHEST for action security_group_rules [ 801.637050] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 801.637105] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eaf11d0-f76c-4a3a-8018-ecc411f189d4 with Priority: HIGHEST for action security_group_members [ 801.638657] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.638657] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.638657] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9eaf11d0-f76c-4a3a-8018-ecc411f189d4 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.638657] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9eaf11d0-f76c-4a3a-8018-ecc411f189d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.638657] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9eaf11d0-f76c-4a3a-8018-ecc411f189d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.639413] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9eaf11d0-f76c-4a3a-8018-ecc411f189d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.639413] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9eaf11d0-f76c-4a3a-8018-ecc411f189d4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.642310] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4e0cfba-8016-40f3-90aa-98a94645d23c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.642310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.642989] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-aed4d3f8-2aac-49ae-9149-5c9c9d62738f taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.642989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aed4d3f8-2aac-49ae-9149-5c9c9d62738f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.642989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aed4d3f8-2aac-49ae-9149-5c9c9d62738f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.642989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aed4d3f8-2aac-49ae-9149-5c9c9d62738f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.642989] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aed4d3f8-2aac-49ae-9149-5c9c9d62738f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.644417] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4e0cfba-8016-40f3-90aa-98a94645d23c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.644515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.644848] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.645071] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.645280] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eaf11d0-f76c-4a3a-8018-ecc411f189d4 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.645323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eaf11d0-f76c-4a3a-8018-ecc411f189d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.946544] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.022084] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.022305] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.022435] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.022708] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.022861] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.023100] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 05724813-8a2b-49a4-af52-46b221530f15 not found, creating... [ 802.023712] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.023712] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.023712] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.023992] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.024157] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.024613] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.024728] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.024806] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.025028] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.025170] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.025312] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 05724813-8a2b-49a4-af52-46b221530f15 is going to be created. [ 802.033850] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 392028d0-93e9-4420-8ca7-d3fa218b5c83: rpc.has_security_group_logging(os_id): False [ 802.040356] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.041409] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9eaf11d0-f76c-4a3a-8018-ecc411f189d4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.044936] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4e0cfba-8016-40f3-90aa-98a94645d23c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.044936] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.045140] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.045274] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.045675] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.046727] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.046727] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-05724813-8a2b-49a4-af52-46b221530f15" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.046844] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4e0cfba-8016-40f3-90aa-98a94645d23c: rpc.has_security_group_logging(os_id): False [ 802.051330] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.051448] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.051521] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.051758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.051846] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.052070] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.052170] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.052244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.052381] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.052453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.052625] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.052713] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.052782] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.052918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.052988] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.053191] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.053282] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.053341] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.053474] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.053542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.053622] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 is going to be updated. [ 802.071568] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.072182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.072182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.072182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.072182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.072555] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.072690] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.072942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.073012] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.073105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.073194] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4e0cfba-8016-40f3-90aa-98a94645d23c is going to be created. [ 802.140981] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.140981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.140981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.140981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.140981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.144669] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aed4d3f8-2aac-49ae-9149-5c9c9d62738f with status ACTIVE [ 802.145111] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.145408] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.145899] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.146519] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.146716] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.147225] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.147458] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.147603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.147929] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.148125] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.148452] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.148820] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.149203] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.149482] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.149654] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.151107] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aed4d3f8-2aac-49ae-9149-5c9c9d62738f is going to be updated. [ 802.151717] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eaf11d0-f76c-4a3a-8018-ecc411f189d4 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.152325] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eaf11d0-f76c-4a3a-8018-ecc411f189d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.159674] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.159674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.159674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.159674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.159674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.175112] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4e0cfba-8016-40f3-90aa-98a94645d23c in Status: IN_PROGRESS for 2s [ 802.209787] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: IN_PROGRESS for 2s [ 802.213894] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.213894] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.213894] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.213894] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.213894] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.213894] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aed4d3f8-2aac-49ae-9149-5c9c9d62738f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.323151] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73004faf-0413-4eab-8656-b74e62d17245 in Status: SUCCESS [ 802.325593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.325593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.325593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.325593] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.325593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.325593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.325593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.325593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.325593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.325593] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('73004faf-0413-4eab-8656-b74e62d17245',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.449559] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.543288] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.549285] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4e0cfba-8016-40f3-90aa-98a94645d23c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.549285] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9eaf11d0-f76c-4a3a-8018-ecc411f189d4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.827581] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-73004faf-0413-4eab-8656-b74e62d17245 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.827739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.827811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.828039] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.828285] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.828374] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.828443] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.828572] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.828679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.828777] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.828969] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-73004faf-0413-4eab-8656-b74e62d17245 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.829064] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.829129] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.829292] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.829432] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.829523] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.829580] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.829736] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.829812] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.829855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.829947] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('73004faf-0413-4eab-8656-b74e62d17245',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.951833] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.953984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.953984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.953984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.953984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.953984] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fab5e96-3f01-4c71-994f-69059ca62986 is going to be updated. [ 802.966943] env[69559]: INFO networking_nsxv3.common.synchronization [None req-9002a8aa-f334-40dc-b039-88d08b8b3fb9 None None] Enqueued Resource ID: 51a8860a-8251-44dd-b58b-e7482c8c31eb with Priority: HIGHEST for action port [ 802.967214] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51a8860a-8251-44dd-b58b-e7482c8c31eb with Priority: HIGHEST for action port [ 802.967783] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-51a8860a-8251-44dd-b58b-e7482c8c31eb taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.967945] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51a8860a-8251-44dd-b58b-e7482c8c31eb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.968039] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51a8860a-8251-44dd-b58b-e7482c8c31eb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.968351] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51a8860a-8251-44dd-b58b-e7482c8c31eb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.968447] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51a8860a-8251-44dd-b58b-e7482c8c31eb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.997273] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.997553] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.997553] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.998781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.998781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.007379] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: IN_PROGRESS for 2s [ 803.050521] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.050866] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.050866] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.051041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.051125] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.051227] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4e0cfba-8016-40f3-90aa-98a94645d23c is going to be updated. [ 803.052638] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.052813] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.052881] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.056293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.056293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.056293] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 is going to be updated. [ 803.056293] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.056293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.056293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.056293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.056293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.056293] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9eaf11d0-f76c-4a3a-8018-ecc411f189d4 is going to be created. [ 803.085677] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.085932] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.086701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.086701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.086863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.089677] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.090069] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.090069] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.090296] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.090296] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.092176] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.092297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.092354] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.093524] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.093524] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.097568] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eaf11d0-f76c-4a3a-8018-ecc411f189d4 in Status: UNINITIALIZED for 2s [ 803.101258] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: IN_PROGRESS for 2s [ 803.101908] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4e0cfba-8016-40f3-90aa-98a94645d23c in Status: IN_PROGRESS for 2s [ 803.339230] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 73004faf-0413-4eab-8656-b74e62d17245: rpc.has_security_group_logging(os_id): False [ 803.361245] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.361524] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.361524] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.362356] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.362484] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.362895] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.363022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.363103] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.363384] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.363563] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.363810] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.363916] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.363979] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.364240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.364338] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.364600] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.364699] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.364749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.364919] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.365033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.366364] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73004faf-0413-4eab-8656-b74e62d17245 is going to be created. [ 803.434243] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.434243] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.434412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.434764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.434835] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.453716] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73004faf-0413-4eab-8656-b74e62d17245 in Status: IN_PROGRESS for 2s [ 803.466199] env[69559]: INFO networking_nsxv3.common.synchronization [req-1d115499-342b-4091-ba79-cb1d6d90d94e req-a9a170cc-07c8-442f-b7de-ab0a20ee7fae tempest-ServersTestBootFromVolume-895220158 tempest-ServersTestBootFromVolume-895220158-project-member] Enqueued Resource ID: 71804139-4bc8-4998-a537-3cd9da947efb with Priority: HIGHEST for action security_group_members [ 803.466959] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71804139-4bc8-4998-a537-3cd9da947efb with Priority: HIGHEST for action security_group_members [ 803.468961] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-71804139-4bc8-4998-a537-3cd9da947efb taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.469151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.469254] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.469566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.470422] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.470530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.470601] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.472038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.472106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.472267] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71804139-4bc8-4998-a537-3cd9da947efb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.473405] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51a8860a-8251-44dd-b58b-e7482c8c31eb [ 803.475764] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.475764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.475764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.475764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.475764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.477381] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51a8860a-8251-44dd-b58b-e7482c8c31eb already deleted. [ 803.477381] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51a8860a-8251-44dd-b58b-e7482c8c31eb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.491291] env[69559]: INFO networking_nsxv3.common.synchronization [req-53b4707b-30ac-454c-8268-b8f7d9cafb92 req-233cce30-2fbe-4abe-bcfa-eb8bda971b08 service nova] Enqueued Resource ID: e657c0bf-1532-4777-b875-72ff585a9315 with Priority: HIGHEST for action security_group_rules [ 803.491833] env[69559]: INFO networking_nsxv3.common.synchronization [req-53b4707b-30ac-454c-8268-b8f7d9cafb92 req-233cce30-2fbe-4abe-bcfa-eb8bda971b08 service nova] Enqueued Resource ID: e657c0bf-1532-4777-b875-72ff585a9315 with Priority: HIGHEST for action security_group_members [ 803.491833] env[69559]: INFO networking_nsxv3.common.synchronization [req-53b4707b-30ac-454c-8268-b8f7d9cafb92 req-233cce30-2fbe-4abe-bcfa-eb8bda971b08 service nova] Enqueued Resource ID: 05724813-8a2b-49a4-af52-46b221530f15 with Priority: HIGHEST for action port [ 803.492314] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e657c0bf-1532-4777-b875-72ff585a9315 with Priority: HIGHEST for action security_group_rules [ 803.492866] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e657c0bf-1532-4777-b875-72ff585a9315 with Priority: HIGHEST for action security_group_members [ 803.492866] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05724813-8a2b-49a4-af52-46b221530f15 with Priority: HIGHEST for action port [ 803.492978] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e657c0bf-1532-4777-b875-72ff585a9315 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.493075] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.494074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.494074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.494074] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e657c0bf-1532-4777-b875-72ff585a9315',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.495086] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e657c0bf-1532-4777-b875-72ff585a9315 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.495928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.495928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.495928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.495928] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.495928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.496311] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.496311] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.496394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.496497] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e657c0bf-1532-4777-b875-72ff585a9315',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.497470] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-05724813-8a2b-49a4-af52-46b221530f15 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.498028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05724813-8a2b-49a4-af52-46b221530f15" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.498028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05724813-8a2b-49a4-af52-46b221530f15" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.498028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05724813-8a2b-49a4-af52-46b221530f15" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.498229] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05724813-8a2b-49a4-af52-46b221530f15',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.970136] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-287 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.970368] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-287" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.970468] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-287" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.970779] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-287" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.971195] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.971361] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.971400] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.971846] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.971846] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.972051] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.972051] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 803.972262] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 803.972262] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 803.972613] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.972613] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 803.972613] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 803.978830] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.978975] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.979057] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.979259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.979358] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.979551] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.979647] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.980523] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.980523] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.980523] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.980523] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71804139-4bc8-4998-a537-3cd9da947efb already deleted. [ 803.980523] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.993085] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 803.993085] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 803.993085] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 803.993085] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-287" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.993343] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-72f31444-ee86-4996-b782-5e92ab70df80 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.993343] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-72f31444-ee86-4996-b782-5e92ab70df80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.993460] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-72f31444-ee86-4996-b782-5e92ab70df80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.995031] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-72f31444-ee86-4996-b782-5e92ab70df80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.995179] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72f31444-ee86-4996-b782-5e92ab70df80',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.000035] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e657c0bf-1532-4777-b875-72ff585a9315',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.000834] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e657c0bf-1532-4777-b875-72ff585a9315 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.000947] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.001275] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05724813-8a2b-49a4-af52-46b221530f15 with status ACTIVE [ 804.001456] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.001570] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.001617] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.001794] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.001875] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.002045] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.002135] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.002199] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.002339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.002413] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.003620] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.003620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.003620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.003620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.003620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.003620] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05724813-8a2b-49a4-af52-46b221530f15 is going to be updated. [ 804.025202] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.025357] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.025511] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.025725] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.025858] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.026064] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05724813-8a2b-49a4-af52-46b221530f15" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.197589] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4e0cfba-8016-40f3-90aa-98a94645d23c in Status: SUCCESS [ 804.197722] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.198647] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.198900] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.199030] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4e0cfba-8016-40f3-90aa-98a94645d23c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.213333] env[69559]: INFO networking_nsxv3.common.synchronization [None req-a59ab0f8-05d8-4a5f-8774-822ffe9d853b tempest-ServerActionsTestOtherB-703157979 tempest-ServerActionsTestOtherB-703157979-project-member] Enqueued Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_rules [ 804.217753] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_rules [ 804.217753] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64914acb-965b-4269-aaa5-676103c45a62 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.217753] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.217753] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.217753] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.217753] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.228698] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: SUCCESS [ 804.228992] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.229733] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.230728] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.232030] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.309225] env[69559]: INFO networking_nsxv3.common.synchronization [None req-99f0d161-3335-48ee-a38d-42c616834d05 tempest-ServerActionsTestOtherB-703157979 tempest-ServerActionsTestOtherB-703157979-project-member] Enqueued Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_rules [ 804.309225] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_rules [ 804.309225] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64914acb-965b-4269-aaa5-676103c45a62 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.309225] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.497944] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.499329] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.499329] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.499329] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.499329] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.499329] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 72f31444-ee86-4996-b782-5e92ab70df80 not found, creating... [ 804.500031] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.500162] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.500341] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.500655] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.501612] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.501612] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.501612] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.501612] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.501769] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.501818] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.501967] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 72f31444-ee86-4996-b782-5e92ab70df80 is going to be created. [ 804.503111] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e657c0bf-1532-4777-b875-72ff585a9315',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.524045] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.524045] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.524045] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.524045] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.524045] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.524045] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-72f31444-ee86-4996-b782-5e92ab70df80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.705964] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4e0cfba-8016-40f3-90aa-98a94645d23c taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.705964] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.734194] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.734194] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.738064] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.738556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.738752] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.741261] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.741261] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.741261] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64914acb-965b-4269-aaa5-676103c45a62 already deleted. [ 804.741261] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.741261] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.741261] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.741261] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.006194] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.006525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.006525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.006806] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.006941] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.007094] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e657c0bf-1532-4777-b875-72ff585a9315 is going to be created. [ 805.023641] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: SUCCESS [ 805.024110] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.024797] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.025089] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.025298] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.025477] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.025581] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.027084] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.027605] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.027780] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.028373] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.035562] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.035734] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.035951] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.036229] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.036434] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.047867] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e657c0bf-1532-4777-b875-72ff585a9315 in Status: UNINITIALIZED for 2s [ 805.062301] env[69559]: INFO networking_nsxv3.common.synchronization [req-3533d91f-cd2d-479f-b66f-774b90780d0b req-608009d5-5061-4303-b1d2-30036106946a tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 9eaf11d0-f76c-4a3a-8018-ecc411f189d4 with Priority: HIGHEST for action security_group_members [ 805.062480] env[69559]: INFO networking_nsxv3.common.synchronization [req-3533d91f-cd2d-479f-b66f-774b90780d0b req-608009d5-5061-4303-b1d2-30036106946a tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 805.062613] env[69559]: INFO networking_nsxv3.common.synchronization [req-3533d91f-cd2d-479f-b66f-774b90780d0b req-608009d5-5061-4303-b1d2-30036106946a tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: a4e0cfba-8016-40f3-90aa-98a94645d23c with Priority: HIGHEST for action security_group_members [ 805.063104] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eaf11d0-f76c-4a3a-8018-ecc411f189d4 with Priority: HIGHEST for action security_group_members [ 805.063240] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 805.069352] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4e0cfba-8016-40f3-90aa-98a94645d23c with Priority: HIGHEST for action security_group_members [ 805.069352] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-9eaf11d0-f76c-4a3a-8018-ecc411f189d4 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.069352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9eaf11d0-f76c-4a3a-8018-ecc411f189d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.069352] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.069352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.069352] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4e0cfba-8016-40f3-90aa-98a94645d23c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.069352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.107358] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9eaf11d0-f76c-4a3a-8018-ecc411f189d4 in Status: SUCCESS [ 805.107664] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eaf11d0-f76c-4a3a-8018-ecc411f189d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.107802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eaf11d0-f76c-4a3a-8018-ecc411f189d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.108034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eaf11d0-f76c-4a3a-8018-ecc411f189d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.108287] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.108436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.108522] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.108702] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.108866] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.108916] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9eaf11d0-f76c-4a3a-8018-ecc411f189d4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.115506] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: SUCCESS [ 805.115709] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.115871] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.116516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.116516] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.116516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.116516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.116787] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.116787] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.116787] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.117993] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4e0cfba-8016-40f3-90aa-98a94645d23c in Status: SUCCESS [ 805.118580] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.118925] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.118925] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.119147] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.119299] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.119393] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.119580] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.119737] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.119905] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4e0cfba-8016-40f3-90aa-98a94645d23c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.262342] env[69559]: INFO networking_nsxv3.common.synchronization [req-1d115499-342b-4091-ba79-cb1d6d90d94e req-79116f62-4c91-4ccc-b44f-4ca1b775c7ff service nova] Enqueued Resource ID: 71804139-4bc8-4998-a537-3cd9da947efb with Priority: HIGHEST for action security_group_rules [ 805.262342] env[69559]: INFO networking_nsxv3.common.synchronization [req-1d115499-342b-4091-ba79-cb1d6d90d94e req-79116f62-4c91-4ccc-b44f-4ca1b775c7ff service nova] Enqueued Resource ID: 71804139-4bc8-4998-a537-3cd9da947efb with Priority: HIGHEST for action security_group_members [ 805.262342] env[69559]: INFO networking_nsxv3.common.synchronization [req-1d115499-342b-4091-ba79-cb1d6d90d94e req-79116f62-4c91-4ccc-b44f-4ca1b775c7ff service nova] Enqueued Resource ID: 72f31444-ee86-4996-b782-5e92ab70df80 with Priority: HIGHEST for action port [ 805.262342] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71804139-4bc8-4998-a537-3cd9da947efb with Priority: HIGHEST for action security_group_rules [ 805.262342] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71804139-4bc8-4998-a537-3cd9da947efb with Priority: HIGHEST for action security_group_members [ 805.262342] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f31444-ee86-4996-b782-5e92ab70df80 with Priority: HIGHEST for action port [ 805.263817] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71804139-4bc8-4998-a537-3cd9da947efb taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.264097] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.264408] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.264729] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.264924] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71804139-4bc8-4998-a537-3cd9da947efb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.266833] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-71804139-4bc8-4998-a537-3cd9da947efb taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.267036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.267164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.267427] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.267629] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.267767] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.267859] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.268073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.268309] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.268457] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71804139-4bc8-4998-a537-3cd9da947efb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.270557] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-72f31444-ee86-4996-b782-5e92ab70df80 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.270557] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72f31444-ee86-4996-b782-5e92ab70df80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.270557] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72f31444-ee86-4996-b782-5e92ab70df80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.270557] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72f31444-ee86-4996-b782-5e92ab70df80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.270557] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72f31444-ee86-4996-b782-5e92ab70df80',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.273792] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.274024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.274148] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.277067] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.277155] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.277265] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64914acb-965b-4269-aaa5-676103c45a62 already deleted. [ 805.277407] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.468305] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73004faf-0413-4eab-8656-b74e62d17245 in Status: SUCCESS [ 805.468663] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.532065] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.532261] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.532309] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.532527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.532709] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.532800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.532868] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.533080] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.533173] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.533259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.533441] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.533539] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.533614] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.533807] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.533960] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.534105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.534190] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.534377] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.534468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.534552] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.534663] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.614204] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.614204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.614204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.614204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.614204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.614204] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.614204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.614204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.614204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.614204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.614204] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9eaf11d0-f76c-4a3a-8018-ecc411f189d4 is going to be deleted. [ 805.622535] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.624456] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.624456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.624456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.624456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.624456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.624456] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.624826] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.624826] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.624826] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.624826] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.624961] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4e0cfba-8016-40f3-90aa-98a94645d23c is going to be updated. [ 805.650818] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.651884] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.652036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.652456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.652560] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.652728] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eaf11d0-f76c-4a3a-8018-ecc411f189d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.652899] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eaf11d0-f76c-4a3a-8018-ecc411f189d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.653138] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eaf11d0-f76c-4a3a-8018-ecc411f189d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.653374] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.653491] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.653571] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.653740] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.653791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.653886] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9eaf11d0-f76c-4a3a-8018-ecc411f189d4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.662411] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.662594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.662594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.662881] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.663065] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.673491] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4e0cfba-8016-40f3-90aa-98a94645d23c in Status: IN_PROGRESS for 2s [ 805.772646] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('71804139-4bc8-4998-a537-3cd9da947efb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.774734] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-71804139-4bc8-4998-a537-3cd9da947efb taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.774734] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.779165] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72f31444-ee86-4996-b782-5e92ab70df80 with status ACTIVE [ 805.782020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.782020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.782020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.782020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.782020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.782020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.782020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.782020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.782020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.782020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.782020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.782020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.782020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.782020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.782020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.782020] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72f31444-ee86-4996-b782-5e92ab70df80 is going to be updated. [ 805.803571] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.803916] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.803997] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.804230] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.804388] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.805326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72f31444-ee86-4996-b782-5e92ab70df80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.964868] env[69559]: INFO networking_nsxv3.common.synchronization [None req-315c11d1-481e-44a6-93bf-2d6ede3ddcf2 None None] Enqueued Resource ID: 569987c0-c564-4556-b9c3-4e955cc7350d with Priority: HIGHEST for action port [ 805.965719] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 569987c0-c564-4556-b9c3-4e955cc7350d with Priority: HIGHEST for action port [ 805.966541] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-569987c0-c564-4556-b9c3-4e955cc7350d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.966694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-569987c0-c564-4556-b9c3-4e955cc7350d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.966878] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-569987c0-c564-4556-b9c3-4e955cc7350d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.967469] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-569987c0-c564-4556-b9c3-4e955cc7350d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.967469] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('569987c0-c564-4556-b9c3-4e955cc7350d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.041742] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fab5e96-3f01-4c71-994f-69059ca62986: rpc.has_security_group_logging(os_id): False [ 806.054118] env[69559]: INFO networking_nsxv3.common.synchronization [req-32efc033-7d78-42ba-b43c-cdfb4c361135 req-4193414a-4b14-42be-bd47-2efa842eb68a tempest-ServersWithSpecificFlavorTestJSON-1886354194 tempest-ServersWithSpecificFlavorTestJSON-1886354194-project-member] Enqueued Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGHEST for action security_group_members [ 806.054118] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGHEST for action security_group_members [ 806.054118] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-38ad73d3-d173-4ff2-9e1d-72777311ba4d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.054118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.054118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.055459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.055732] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.055965] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.057500] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.057500] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.057500] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.057500] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.063017] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.063017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.063017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.063017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.063017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.063017] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.063017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.063017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.063017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.063017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.063017] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.063017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.063017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.063017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.063017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.063563] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.063563] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.063563] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.063563] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.063563] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.063563] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fab5e96-3f01-4c71-994f-69059ca62986 is going to be updated. [ 806.124282] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.127605] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.127605] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.127605] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.127605] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.127993] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.139019] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: IN_PROGRESS for 2s [ 806.156512] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.157193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.157193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.157193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.157467] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.157707] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.157813] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.157892] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.158100] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.158182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.158273] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9eaf11d0-f76c-4a3a-8018-ecc411f189d4 already deleted. [ 806.158386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eaf11d0-f76c-4a3a-8018-ecc411f189d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.158534] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9eaf11d0-f76c-4a3a-8018-ecc411f189d4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.159739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9eaf11d0-f76c-4a3a-8018-ecc411f189d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.159976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9eaf11d0-f76c-4a3a-8018-ecc411f189d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.160201] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.160322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.160400] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.160587] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.160677] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.160766] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9eaf11d0-f76c-4a3a-8018-ecc411f189d4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.275917] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('71804139-4bc8-4998-a537-3cd9da947efb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.471385] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 569987c0-c564-4556-b9c3-4e955cc7350d [ 806.471385] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.471385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.471385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.471385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.471385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.471385] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:569987c0-c564-4556-b9c3-4e955cc7350d already deleted. [ 806.471385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-569987c0-c564-4556-b9c3-4e955cc7350d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.561255] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.561255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.561255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.561255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.561255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.561255] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.561255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.561255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.561255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.561255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.561255] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d is going to be updated. [ 806.590893] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.590893] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.590893] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.590893] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.590893] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.598186] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d in Status: IN_PROGRESS for 2s [ 806.632203] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.633171] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.633333] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.633626] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.633778] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.633931] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 is going to be updated. [ 806.662668] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9eaf11d0-f76c-4a3a-8018-ecc411f189d4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.663782] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.663918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.664057] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.664224] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.664322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.664501] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.664602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.664666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.664813] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.664889] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.664973] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9eaf11d0-f76c-4a3a-8018-ecc411f189d4 already deleted. [ 806.665063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9eaf11d0-f76c-4a3a-8018-ecc411f189d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.673200] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.673311] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.673355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.673532] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.673663] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.683500] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: IN_PROGRESS for 2s [ 806.723931] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-650 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.724067] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-650" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.725024] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-650" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.725024] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-650" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.725024] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.725024] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.725024] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.725298] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.725333] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.725537] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.725652] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.725763] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.725873] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.725981] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.726130] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.726270] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.746018] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.746018] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 806.746018] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.746018] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-650" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.746313] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-275a0159-fa20-4fe3-b5e2-f46212857dae taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.746490] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-275a0159-fa20-4fe3-b5e2-f46212857dae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.746622] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-275a0159-fa20-4fe3-b5e2-f46212857dae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.747086] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-275a0159-fa20-4fe3-b5e2-f46212857dae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.747324] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('275a0159-fa20-4fe3-b5e2-f46212857dae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.780233] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.780233] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.780233] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.780233] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.780233] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.780233] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71804139-4bc8-4998-a537-3cd9da947efb is going to be created. [ 806.803559] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.803759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.803854] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.804159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.804366] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.814685] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71804139-4bc8-4998-a537-3cd9da947efb in Status: UNINITIALIZED for 2s [ 807.057493] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e657c0bf-1532-4777-b875-72ff585a9315 in Status: SUCCESS [ 807.057760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.057861] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.058089] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.058314] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.058439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.058487] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.058632] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.058710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.058809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.058870] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e657c0bf-1532-4777-b875-72ff585a9315',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.166446] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9eaf11d0-f76c-4a3a-8018-ecc411f189d4: rpc.has_security_group_logging(os_id): False [ 807.196040] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.196218] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.196292] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.196514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.196607] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.196832] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.196931] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.196995] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.197157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.197227] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.197309] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9eaf11d0-f76c-4a3a-8018-ecc411f189d4 is going to be created. [ 807.232456] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/9eaf11d0-f76c-4a3a-8018-ecc411f189d4], does not exist path=[/infra/domains/default/groups/9eaf11d0-f76c-4a3a-8018-ecc411f189d4]."\n}' [ 807.232671] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9eaf11d0-f76c-4a3a-8018-ecc411f189d4 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9eaf11d0-f76c-4a3a-8018-ecc411f189d4 [ 807.232783] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 807.250654] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.250896] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.251032] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.251328] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.251482] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.251637] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 275a0159-fa20-4fe3-b5e2-f46212857dae not found, creating... [ 807.251891] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.252062] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.252185] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.252467] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.252634] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.252919] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.253090] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.253212] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.253421] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.253560] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.253700] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 275a0159-fa20-4fe3-b5e2-f46212857dae is going to be created. [ 807.285738] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.285963] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.286106] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.286472] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.286706] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.286932] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-275a0159-fa20-4fe3-b5e2-f46212857dae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.320410] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.320573] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.320641] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.320859] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.322077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.322372] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.322522] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.322848] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.322848] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.322848] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.322990] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.323104] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.323167] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.323314] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.323391] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.323477] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9eaf11d0-f76c-4a3a-8018-ecc411f189d4 is going to be created. [ 807.343673] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/9eaf11d0-f76c-4a3a-8018-ecc411f189d4], does not exist path=[/infra/domains/default/groups/9eaf11d0-f76c-4a3a-8018-ecc411f189d4]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9eaf11d0-f76c-4a3a-8018-ecc411f189d4 [ 807.343673] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9eaf11d0-f76c-4a3a-8018-ecc411f189d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.343896] env[69559]: Traceback (most recent call last): [ 807.343896] env[69559]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 807.343896] env[69559]: return func(*args, **kwargs) [ 807.343896] env[69559]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 807.343896] env[69559]: res.raise_for_status() [ 807.343896] env[69559]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 807.343896] env[69559]: raise HTTPError(http_error_msg, response=self) [ 807.343896] env[69559]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9eaf11d0-f76c-4a3a-8018-ecc411f189d4 [ 807.343896] env[69559]: During handling of the above exception, another exception occurred: [ 807.343896] env[69559]: Traceback (most recent call last): [ 807.343896] env[69559]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 807.343896] env[69559]: listener.cb(fileno) [ 807.343896] env[69559]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 807.343896] env[69559]: result = function(*args, **kwargs) [ 807.343896] env[69559]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 807.343896] env[69559]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 807.343896] env[69559]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 807.343896] env[69559]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 807.343896] env[69559]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 807.343896] env[69559]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 807.343896] env[69559]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 807.343896] env[69559]: res.raise_for_status() [ 807.343896] env[69559]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 807.343896] env[69559]: raise HTTPError(http_error_msg, response=self) [ 807.343896] env[69559]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9eaf11d0-f76c-4a3a-8018-ecc411f189d4 [ 807.343896] env[69559]: Removing descriptor: 5 [ 807.561580] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e657c0bf-1532-4777-b875-72ff585a9315 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.561580] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.561580] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.561836] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.561931] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.562618] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.562693] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.564122] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.564122] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.564122] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.564122] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e657c0bf-1532-4777-b875-72ff585a9315 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.564122] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.564122] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.564122] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.564122] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.564122] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.564122] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.564122] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.564122] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.564122] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.564650] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e657c0bf-1532-4777-b875-72ff585a9315',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.684514] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4e0cfba-8016-40f3-90aa-98a94645d23c in Status: SUCCESS [ 807.684856] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4e0cfba-8016-40f3-90aa-98a94645d23c deletion is rescheduled due to dependency. [ 807.684856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.685056] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.685317] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.685669] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.685669] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.685802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.685864] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.685989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.686118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.686364] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4e0cfba-8016-40f3-90aa-98a94645d23c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.687280] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.687520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.688556] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.688556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.688556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.688556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.688556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.688556] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4e0cfba-8016-40f3-90aa-98a94645d23c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.951319] env[69559]: INFO networking_nsxv3.common.synchronization [req-32efc033-7d78-42ba-b43c-cdfb4c361135 req-ea11c45c-e318-437f-8e77-2ad0a7f5e931 service nova] Enqueued Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGHEST for action security_group_rules [ 807.953203] env[69559]: INFO networking_nsxv3.common.synchronization [req-32efc033-7d78-42ba-b43c-cdfb4c361135 req-ea11c45c-e318-437f-8e77-2ad0a7f5e931 service nova] Enqueued Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGHEST for action security_group_members [ 807.953203] env[69559]: INFO networking_nsxv3.common.synchronization [req-32efc033-7d78-42ba-b43c-cdfb4c361135 req-ea11c45c-e318-437f-8e77-2ad0a7f5e931 service nova] Enqueued Resource ID: 275a0159-fa20-4fe3-b5e2-f46212857dae with Priority: HIGHEST for action port [ 807.953203] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGHEST for action security_group_rules [ 807.953203] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGHEST for action security_group_members [ 807.953203] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 275a0159-fa20-4fe3-b5e2-f46212857dae with Priority: HIGHEST for action port [ 807.953203] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.953203] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.953203] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.953768] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.954028] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.955139] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-38ad73d3-d173-4ff2-9e1d-72777311ba4d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.955345] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.955636] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-275a0159-fa20-4fe3-b5e2-f46212857dae taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.955844] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-275a0159-fa20-4fe3-b5e2-f46212857dae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.955981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-275a0159-fa20-4fe3-b5e2-f46212857dae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.956260] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-275a0159-fa20-4fe3-b5e2-f46212857dae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.956422] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('275a0159-fa20-4fe3-b5e2-f46212857dae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.067450] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e657c0bf-1532-4777-b875-72ff585a9315: rpc.has_security_group_logging(os_id): False [ 808.096662] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.096662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.096662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.096662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.096662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.096662] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.096662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.096662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.096662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.096662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.096662] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.096662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.096662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.096662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.096662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.097298] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.097298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.097298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.097298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.097298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.097298] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e657c0bf-1532-4777-b875-72ff585a9315 is going to be created. [ 808.154266] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: SUCCESS [ 808.154512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.169136] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.169351] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.169385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.169576] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.169749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.185100] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e657c0bf-1532-4777-b875-72ff585a9315 in Status: IN_PROGRESS for 2s [ 808.189509] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4e0cfba-8016-40f3-90aa-98a94645d23c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.190489] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.190628] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.190688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.190889] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.220293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.220498] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.220752] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.220752] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.220905] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.220992] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.221096] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4e0cfba-8016-40f3-90aa-98a94645d23c is going to be updated. [ 808.274565] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.274805] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.274869] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.275105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.275276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.291098] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4e0cfba-8016-40f3-90aa-98a94645d23c in Status: IN_PROGRESS for 2s [ 808.461021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-38ad73d3-d173-4ff2-9e1d-72777311ba4d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.461021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.461021] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 275a0159-fa20-4fe3-b5e2-f46212857dae with status ACTIVE [ 808.461021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.461021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.461021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.461021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.461021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.461021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.461021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.461021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.461021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.461021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.461021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.461633] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.461633] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.461633] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.461633] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.461633] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 275a0159-fa20-4fe3-b5e2-f46212857dae is going to be updated. [ 808.486371] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.487182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.487182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.487182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.487182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.487182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-275a0159-fa20-4fe3-b5e2-f46212857dae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.617407] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d in Status: SUCCESS [ 808.617651] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d deletion is rescheduled due to dependency. [ 808.617816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.617946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.618292] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.618540] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.618682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.618752] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.618912] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.619028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.619163] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.693296] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4e0cfba-8016-40f3-90aa-98a94645d23c: rpc.has_security_group_logging(os_id): False [ 808.698391] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: SUCCESS [ 808.698391] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.698391] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.698547] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.698825] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.700644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.700644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.700644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.700644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.700644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.700644] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.700644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.700644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.701600] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.701600] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.701600] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.701600] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.701600] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.701600] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.733673] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.736196] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.736196] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.736196] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.736196] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.736196] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.736196] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.736196] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.736196] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.736196] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.736196] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4e0cfba-8016-40f3-90aa-98a94645d23c is going to be updated. [ 808.824911] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.825079] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.825154] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.825376] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.825519] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.830905] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71804139-4bc8-4998-a537-3cd9da947efb in Status: SUCCESS [ 808.831120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.831281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.831481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.831667] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.833019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.833019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.833019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.833019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.833019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.833019] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('71804139-4bc8-4998-a537-3cd9da947efb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.840062] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4e0cfba-8016-40f3-90aa-98a94645d23c in Status: IN_PROGRESS for 2s [ 809.122236] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.203490] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.203747] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.207207] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.336057] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('71804139-4bc8-4998-a537-3cd9da947efb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.624387] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.731491] env[69559]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 809.731729] env[69559]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] NSXv3 Agent Agent loop - iteration:1 started [ 809.735513] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.837645] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 71804139-4bc8-4998-a537-3cd9da947efb: rpc.has_security_group_logging(os_id): False [ 809.856513] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.856669] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.856764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.856968] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.857076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.857325] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.857423] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.857486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.857651] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.857719] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.857803] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71804139-4bc8-4998-a537-3cd9da947efb is going to be created. [ 809.935381] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.935381] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.935381] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.935809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.935867] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.949246] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71804139-4bc8-4998-a537-3cd9da947efb in Status: IN_PROGRESS for 2s [ 810.127087] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.127550] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.127550] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.127550] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.127701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.127701] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d is going to be updated. [ 810.164160] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.164319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.164319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.164710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.164785] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.174443] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d in Status: IN_PROGRESS for 2s [ 810.200509] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e657c0bf-1532-4777-b875-72ff585a9315 in Status: SUCCESS [ 810.200509] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.238071] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.238071] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.238071] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.238071] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.238409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.238409] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 is going to be updated. [ 810.270610] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.270739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.270791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.271026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.271221] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.280818] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: IN_PROGRESS for 2s [ 810.301997] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4e0cfba-8016-40f3-90aa-98a94645d23c in Status: SUCCESS [ 810.302218] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4e0cfba-8016-40f3-90aa-98a94645d23c deletion is rescheduled due to dependency. [ 810.302348] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.854344] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4e0cfba-8016-40f3-90aa-98a94645d23c in Status: SUCCESS [ 810.854684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.216676] env[69559]: INFO networking_nsxv3.common.synchronization [req-bce77b42-d796-4495-be7f-af0d7ff8d4b8 req-1a2b8cb9-0a3c-46aa-9e99-df38aa6a5e64 tempest-ServerGroupTestJSON-927310883 tempest-ServerGroupTestJSON-927310883-project-member] Enqueued Resource ID: 73004faf-0413-4eab-8656-b74e62d17245 with Priority: HIGHEST for action security_group_members [ 811.216676] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73004faf-0413-4eab-8656-b74e62d17245 with Priority: HIGHEST for action security_group_members [ 811.216676] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-73004faf-0413-4eab-8656-b74e62d17245 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.216676] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.216676] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.216676] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.216676] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.216676] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.216676] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.216676] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.216676] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.216676] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73004faf-0413-4eab-8656-b74e62d17245',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.389972] env[69559]: INFO networking_nsxv3.common.synchronization [req-9b13a93a-dc04-4019-89b8-4d3d0302089e req-117a31a4-66ed-4a87-adb3-771d5f912dbf tempest-FloatingIPsAssociationTestJSON-1860057914 tempest-FloatingIPsAssociationTestJSON-1860057914-project-member] Enqueued Resource ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 with Priority: HIGHEST for action security_group_members [ 811.390624] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 with Priority: HIGHEST for action security_group_members [ 811.390982] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f7f9d2e-64a3-4672-969a-45f64c5621d1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.391272] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.391361] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.391582] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.391763] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.391880] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.391949] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.392142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.392566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.392566] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f7f9d2e-64a3-4672-969a-45f64c5621d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.719405] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.719569] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.719640] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.719854] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.739803] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.739924] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.740453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.740453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.740453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.740453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.740732] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73004faf-0413-4eab-8656-b74e62d17245 is going to be updated. [ 811.777925] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.778703] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.778777] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.779064] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.779173] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.788449] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73004faf-0413-4eab-8656-b74e62d17245 in Status: IN_PROGRESS for 2s [ 811.894276] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.894495] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.894606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.894726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.915075] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.916068] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.916068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.916068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.916068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.916068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.916068] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 is going to be updated. [ 811.942324] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.942324] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.942324] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.942754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.942996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.950933] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 in Status: IN_PROGRESS for 2s [ 811.960150] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71804139-4bc8-4998-a537-3cd9da947efb in Status: SUCCESS [ 811.960415] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.186470] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d in Status: SUCCESS [ 812.186686] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.186841] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.187072] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.187260] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.187378] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.187445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.187686] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.187737] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.187817] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.187937] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.291683] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: SUCCESS [ 812.292026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.292108] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.292330] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.292519] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.292639] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.292704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.292849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.292929] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.293023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.293227] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.293453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.293547] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.293698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.293843] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.293938] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.293998] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.294166] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.294244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.294326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.294414] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.690860] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.796434] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 392028d0-93e9-4420-8ca7-d3fa218b5c83: rpc.has_security_group_logging(os_id): False [ 812.816796] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.816796] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.816796] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.816796] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.836540] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.836828] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.836951] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.837082] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.837259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.837346] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.837553] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.837645] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.837707] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.837851] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.837923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.838128] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.838221] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.838293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.838438] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.838514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.838600] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 is going to be updated. [ 812.895256] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.895713] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.895713] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.895867] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.895945] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.917915] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: IN_PROGRESS for 2s [ 813.112030] env[69559]: INFO networking_nsxv3.common.synchronization [req-d51fea44-ae31-44a4-98bd-87cdf94a29aa req-2f1f48a2-8385-4d17-a31f-3d173cf21e8a tempest-InstanceActionsTestJSON-789845982 tempest-InstanceActionsTestJSON-789845982-project-member] Enqueued Resource ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 with Priority: HIGHEST for action security_group_members [ 813.112612] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 with Priority: HIGHEST for action security_group_members [ 813.112980] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-89a65a81-7e5b-4da0-99ae-af95bd9df589 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.113123] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.113758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.113758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.113758] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.113758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.113758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.114024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.114024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.114092] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89a65a81-7e5b-4da0-99ae-af95bd9df589',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.193291] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38ad73d3-d173-4ff2-9e1d-72777311ba4d: rpc.has_security_group_logging(os_id): False [ 813.213480] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.214089] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.214089] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.214089] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.233446] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.233764] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.233881] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.233950] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.234165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.234250] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.235183] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d is going to be updated. [ 813.294869] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.295249] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.295249] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.296376] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.296376] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.322683] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d in Status: IN_PROGRESS for 2s [ 813.400105] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-21 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.400430] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-21" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.400647] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-21" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.401124] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-21" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.401544] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.401784] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.401944] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.402236] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.402418] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.402662] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 813.402811] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 813.402973] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 813.404201] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 813.404201] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 813.404201] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 813.404201] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 813.428100] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 813.428677] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 813.428677] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 813.428677] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-21" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.429131] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-8f8dd63f-05f5-4877-8e84-1c2660ece135 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.429821] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-8f8dd63f-05f5-4877-8e84-1c2660ece135" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.429821] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-8f8dd63f-05f5-4877-8e84-1c2660ece135" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.430192] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-8f8dd63f-05f5-4877-8e84-1c2660ece135" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.430406] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f8dd63f-05f5-4877-8e84-1c2660ece135',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.616482] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.616678] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.616775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.617035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.617170] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.617365] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.617472] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.617530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.617685] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.617760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.617844] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 already deleted. [ 813.617925] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.798203] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73004faf-0413-4eab-8656-b74e62d17245 in Status: SUCCESS [ 813.798586] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73004faf-0413-4eab-8656-b74e62d17245 deletion is rescheduled due to dependency. [ 813.798760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.933588] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.933877] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.934108] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.934371] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.934566] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.934757] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 8f8dd63f-05f5-4877-8e84-1c2660ece135 not found, creating... [ 813.935188] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.935277] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.935406] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.935682] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.935843] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.936155] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.936373] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.936511] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.936931] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.936931] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.937036] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 8f8dd63f-05f5-4877-8e84-1c2660ece135 is going to be created. [ 813.959270] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.959495] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.959627] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.959894] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.960138] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.960572] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-8f8dd63f-05f5-4877-8e84-1c2660ece135" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.961887] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 in Status: SUCCESS [ 813.961988] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 deletion is rescheduled due to dependency. [ 813.962100] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.657519] env[69559]: INFO networking_nsxv3.common.synchronization [req-d51fea44-ae31-44a4-98bd-87cdf94a29aa req-ecc29843-b182-4b83-9a2d-fbb4fd549dc9 service nova] Enqueued Resource ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 with Priority: HIGHEST for action security_group_rules [ 814.657519] env[69559]: INFO networking_nsxv3.common.synchronization [req-d51fea44-ae31-44a4-98bd-87cdf94a29aa req-ecc29843-b182-4b83-9a2d-fbb4fd549dc9 service nova] Enqueued Resource ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 with Priority: HIGHEST for action security_group_members [ 814.657519] env[69559]: INFO networking_nsxv3.common.synchronization [req-d51fea44-ae31-44a4-98bd-87cdf94a29aa req-ecc29843-b182-4b83-9a2d-fbb4fd549dc9 service nova] Enqueued Resource ID: 8f8dd63f-05f5-4877-8e84-1c2660ece135 with Priority: HIGHEST for action port [ 814.657930] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 with Priority: HIGHEST for action security_group_rules [ 814.657930] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 with Priority: HIGHEST for action security_group_members [ 814.657930] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8dd63f-05f5-4877-8e84-1c2660ece135 with Priority: HIGHEST for action port [ 814.660128] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89a65a81-7e5b-4da0-99ae-af95bd9df589 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.660319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.660396] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.660824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.660824] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89a65a81-7e5b-4da0-99ae-af95bd9df589',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.661778] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-89a65a81-7e5b-4da0-99ae-af95bd9df589 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.661942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.662052] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.662205] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.663385] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.663385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.663385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.663385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.663385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.663385] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89a65a81-7e5b-4da0-99ae-af95bd9df589',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.665533] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f8dd63f-05f5-4877-8e84-1c2660ece135 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.665635] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f8dd63f-05f5-4877-8e84-1c2660ece135" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.665678] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f8dd63f-05f5-4877-8e84-1c2660ece135" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.665830] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f8dd63f-05f5-4877-8e84-1c2660ece135" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.665981] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f8dd63f-05f5-4877-8e84-1c2660ece135',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.933866] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: SUCCESS [ 814.934202] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.168224] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-89a65a81-7e5b-4da0-99ae-af95bd9df589 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.168355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.168539] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89a65a81-7e5b-4da0-99ae-af95bd9df589',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.169490] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f8dd63f-05f5-4877-8e84-1c2660ece135 with status ACTIVE [ 815.169745] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.170408] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.170408] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.170408] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.170408] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.170408] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.170744] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.170744] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.170744] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.170890] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.171764] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.171764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.171764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.171764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.171764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.171764] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f8dd63f-05f5-4877-8e84-1c2660ece135 is going to be updated. [ 815.191670] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.191809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.191871] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.192084] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.192215] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.192373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f8dd63f-05f5-4877-8e84-1c2660ece135" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.336363] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d in Status: SUCCESS [ 815.336630] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.674195] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89a65a81-7e5b-4da0-99ae-af95bd9df589',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.176567] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.176773] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.176821] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.177048] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.177159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.177259] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 is going to be created. [ 816.209575] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.209726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.209797] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.210013] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.210165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.220359] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 in Status: UNINITIALIZED for 2s [ 817.138995] env[69559]: INFO networking_nsxv3.common.synchronization [req-04f398d9-cc3b-4b6e-a569-6af9290af26d req-d9f7dbc7-c046-4a28-a75f-b79a8375d87b tempest-ServersNegativeTestMultiTenantJSON-204731643 tempest-ServersNegativeTestMultiTenantJSON-204731643-project-member] Enqueued Resource ID: e657c0bf-1532-4777-b875-72ff585a9315 with Priority: HIGHEST for action security_group_members [ 817.139713] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e657c0bf-1532-4777-b875-72ff585a9315 with Priority: HIGHEST for action security_group_members [ 817.140823] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e657c0bf-1532-4777-b875-72ff585a9315 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.140957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.141035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.141234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.141429] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.141536] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.141536] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.141701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.141779] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.141876] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e657c0bf-1532-4777-b875-72ff585a9315',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.644222] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.644400] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.644471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.644688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.644779] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.644978] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.645179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.645266] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.645443] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.645548] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.645657] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e657c0bf-1532-4777-b875-72ff585a9315 is going to be updated. [ 817.699248] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.699407] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.699647] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.699730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.700177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.722774] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e657c0bf-1532-4777-b875-72ff585a9315 in Status: IN_PROGRESS for 2s [ 818.233644] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 in Status: SUCCESS [ 818.234089] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.234089] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.234404] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.234549] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.234724] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.234796] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.234950] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.235045] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.235131] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.235222] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('89a65a81-7e5b-4da0-99ae-af95bd9df589',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.587154] env[69559]: INFO networking_nsxv3.common.synchronization [None req-8c71a5c6-629b-43ba-bef6-0009c82dbd6f None None] Enqueued Resource ID: 233f72ab-dccd-4c12-b760-41716b4a3289 with Priority: HIGHEST for action port [ 818.587429] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 233f72ab-dccd-4c12-b760-41716b4a3289 with Priority: HIGHEST for action port [ 818.587966] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-233f72ab-dccd-4c12-b760-41716b4a3289 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.588106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-233f72ab-dccd-4c12-b760-41716b4a3289" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.588175] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-233f72ab-dccd-4c12-b760-41716b4a3289" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.588502] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-233f72ab-dccd-4c12-b760-41716b4a3289" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.588586] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('233f72ab-dccd-4c12-b760-41716b4a3289',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.737118] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-89a65a81-7e5b-4da0-99ae-af95bd9df589 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.737297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.737348] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.737550] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.738086] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.738222] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.738289] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.738436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.738526] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.738654] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.738884] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-89a65a81-7e5b-4da0-99ae-af95bd9df589 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.739023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.739097] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.739284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.739443] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.739534] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.739593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.739732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.739807] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.739878] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.739993] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('89a65a81-7e5b-4da0-99ae-af95bd9df589',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.091101] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 233f72ab-dccd-4c12-b760-41716b4a3289 [ 819.091101] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.091101] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.091101] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.092219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.092219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.092219] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:233f72ab-dccd-4c12-b760-41716b4a3289 already deleted. [ 819.092219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-233f72ab-dccd-4c12-b760-41716b4a3289" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.242700] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 89a65a81-7e5b-4da0-99ae-af95bd9df589: rpc.has_security_group_logging(os_id): False [ 819.261515] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.261515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.261515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.261515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.261515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.261515] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.261756] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.261756] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.261819] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.261924] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.262403] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.262403] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.262403] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.262618] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.262618] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.263527] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.263527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.263527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.263527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.263767] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.263926] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 is going to be created. [ 819.330306] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.330490] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.330545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.330864] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.330905] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.345860] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 in Status: IN_PROGRESS for 2s [ 819.732557] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e657c0bf-1532-4777-b875-72ff585a9315 in Status: SUCCESS [ 819.732795] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e657c0bf-1532-4777-b875-72ff585a9315 deletion is rescheduled due to dependency. [ 819.732882] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.193019] env[69559]: INFO networking_nsxv3.common.synchronization [None req-1d15698d-a833-4d09-8ce8-b74bef106107 None None] Enqueued Resource ID: 17731a5b-4fdc-42a7-83c1-8875d54d3ebf with Priority: HIGHEST for action port [ 821.193019] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17731a5b-4fdc-42a7-83c1-8875d54d3ebf with Priority: HIGHEST for action port [ 821.193019] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-17731a5b-4fdc-42a7-83c1-8875d54d3ebf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.193019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17731a5b-4fdc-42a7-83c1-8875d54d3ebf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.193019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17731a5b-4fdc-42a7-83c1-8875d54d3ebf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.193019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17731a5b-4fdc-42a7-83c1-8875d54d3ebf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.193019] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17731a5b-4fdc-42a7-83c1-8875d54d3ebf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.357341] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 in Status: SUCCESS [ 821.358828] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.628783] env[69559]: INFO networking_nsxv3.common.synchronization [None req-243eeeea-4207-44bc-b1b7-4cbe327c22d2 None None] Enqueued Resource ID: 707532fd-923f-4b22-9af6-63c4ee036e81 with Priority: HIGHEST for action port [ 821.629076] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 707532fd-923f-4b22-9af6-63c4ee036e81 with Priority: HIGHEST for action port [ 821.634052] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-707532fd-923f-4b22-9af6-63c4ee036e81 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.634052] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-707532fd-923f-4b22-9af6-63c4ee036e81" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.634052] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-707532fd-923f-4b22-9af6-63c4ee036e81" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.634052] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-707532fd-923f-4b22-9af6-63c4ee036e81" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.634052] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('707532fd-923f-4b22-9af6-63c4ee036e81',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.699646] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 17731a5b-4fdc-42a7-83c1-8875d54d3ebf [ 821.700070] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.700285] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.701126] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.701502] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.701625] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.702122] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:17731a5b-4fdc-42a7-83c1-8875d54d3ebf already deleted. [ 821.702122] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17731a5b-4fdc-42a7-83c1-8875d54d3ebf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.137179] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 707532fd-923f-4b22-9af6-63c4ee036e81 [ 822.137179] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.137179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.137179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.137179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.137179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.137179] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:707532fd-923f-4b22-9af6-63c4ee036e81 already deleted. [ 822.137503] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-707532fd-923f-4b22-9af6-63c4ee036e81" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.162128] env[69559]: INFO networking_nsxv3.common.synchronization [req-588466d7-c59a-4dc4-8157-f721472d7529 req-3bc92005-7a8e-4013-9360-9159d0a211c6 tempest-ImagesTestJSON-1150485476 tempest-ImagesTestJSON-1150485476-project-member] Enqueued Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 822.162641] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 822.163322] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.163322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.163322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.163486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.163486] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.163582] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.163643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.163783] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.163866] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.163955] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.603062] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-190 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.603062] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-190" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.603062] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-190" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.603485] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-190" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.603567] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.603727] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.603888] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.604803] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.604803] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.605164] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 822.605164] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 822.605342] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 822.605429] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 822.605566] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 822.605686] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 822.605837] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 822.637712] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 822.637994] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 822.638125] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 822.638274] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-190" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.638693] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-998e534b-8a16-4e14-b946-cbabf26664f2 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.638966] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-998e534b-8a16-4e14-b946-cbabf26664f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.639183] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-998e534b-8a16-4e14-b946-cbabf26664f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.639576] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-998e534b-8a16-4e14-b946-cbabf26664f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.639720] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('998e534b-8a16-4e14-b946-cbabf26664f2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.670478] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.670715] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.671716] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.671716] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.706531] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.707420] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.707420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.707420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.708182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.708182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.708182] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 is going to be updated. [ 822.749387] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.749387] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.749387] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.749387] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.749387] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.758676] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: IN_PROGRESS for 2s [ 823.143710] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.143972] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.144120] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.144406] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.144562] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.144716] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 998e534b-8a16-4e14-b946-cbabf26664f2 not found, creating... [ 823.145008] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.145176] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.145293] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.145506] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.145647] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.145927] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.146095] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.146214] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.146477] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.146624] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.147518] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 998e534b-8a16-4e14-b946-cbabf26664f2 is going to be created. [ 823.176926] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.177371] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.177559] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.177929] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.178422] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.178800] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-998e534b-8a16-4e14-b946-cbabf26664f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.882455] env[69559]: INFO networking_nsxv3.common.synchronization [req-588466d7-c59a-4dc4-8157-f721472d7529 req-75db9c6f-d085-4809-8dd1-8de64821edbb service nova] Enqueued Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_rules [ 823.882455] env[69559]: INFO networking_nsxv3.common.synchronization [req-588466d7-c59a-4dc4-8157-f721472d7529 req-75db9c6f-d085-4809-8dd1-8de64821edbb service nova] Enqueued Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 823.882771] env[69559]: INFO networking_nsxv3.common.synchronization [req-588466d7-c59a-4dc4-8157-f721472d7529 req-75db9c6f-d085-4809-8dd1-8de64821edbb service nova] Enqueued Resource ID: 998e534b-8a16-4e14-b946-cbabf26664f2 with Priority: HIGHEST for action port [ 823.882771] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_rules [ 823.883079] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 823.883079] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 998e534b-8a16-4e14-b946-cbabf26664f2 with Priority: HIGHEST for action port [ 823.883497] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.883676] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.883752] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.883954] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.884050] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.884834] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.884929] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.885134] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-998e534b-8a16-4e14-b946-cbabf26664f2 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.885242] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-998e534b-8a16-4e14-b946-cbabf26664f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.885306] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-998e534b-8a16-4e14-b946-cbabf26664f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.885467] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-998e534b-8a16-4e14-b946-cbabf26664f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.885530] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('998e534b-8a16-4e14-b946-cbabf26664f2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.220534] env[69559]: INFO networking_nsxv3.common.synchronization [None req-4ee4e7f3-deb9-494f-ba2f-392e80e5a7d0 None None] Enqueued Resource ID: b9572271-45fb-41e2-b41a-b1b9da9d8bca with Priority: HIGHEST for action port [ 824.220806] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9572271-45fb-41e2-b41a-b1b9da9d8bca with Priority: HIGHEST for action port [ 824.221494] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9572271-45fb-41e2-b41a-b1b9da9d8bca taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.221593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9572271-45fb-41e2-b41a-b1b9da9d8bca" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.221665] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9572271-45fb-41e2-b41a-b1b9da9d8bca" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.221920] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9572271-45fb-41e2-b41a-b1b9da9d8bca" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.222007] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9572271-45fb-41e2-b41a-b1b9da9d8bca',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.389073] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.389073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.389073] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 998e534b-8a16-4e14-b946-cbabf26664f2 with status ACTIVE [ 824.389310] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.389310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.389310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.392133] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.392293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.392789] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.392789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.392789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.393388] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.393388] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.393388] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.393388] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.393644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.393644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.393751] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.393792] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 998e534b-8a16-4e14-b946-cbabf26664f2 is going to be updated. [ 824.420808] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.420808] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.421300] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.421355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.421474] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.421643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-998e534b-8a16-4e14-b946-cbabf26664f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.534601] env[69559]: INFO networking_nsxv3.common.synchronization [req-bb671b6f-f784-4409-bc2f-5fad7a495089 req-128617ad-4eac-4891-b448-f2b3bcdb072a tempest-MigrationsAdminTest-370955767 tempest-MigrationsAdminTest-370955767-project-member] Enqueued Resource ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 with Priority: HIGHEST for action security_group_members [ 824.535234] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 with Priority: HIGHEST for action security_group_members [ 824.535572] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.535709] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.535768] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.535989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.536179] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.536304] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.536386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.536606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.537084] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.537084] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.686588] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.686709] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.686754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.687508] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.687508] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.724616] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9572271-45fb-41e2-b41a-b1b9da9d8bca [ 824.724739] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.724990] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.724990] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.725224] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.726029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.726029] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9572271-45fb-41e2-b41a-b1b9da9d8bca already deleted. [ 824.726029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9572271-45fb-41e2-b41a-b1b9da9d8bca" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.778501] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: SUCCESS [ 824.778501] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 deletion is rescheduled due to dependency. [ 824.778501] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.778765] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.778765] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.779375] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.779375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.779375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.779375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.779375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.779696] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.856647] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-628 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.856862] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.856990] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.857274] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.857547] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.857710] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.857829] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.858049] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.858197] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.858434] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 824.858571] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 824.858686] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 824.858796] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 824.858909] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 824.859023] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 824.859154] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 824.877516] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 824.877728] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 824.877876] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 824.878056] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-628" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.878352] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-b1e7a07c-4ad7-4781-b0aa-47852020ec48 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.878554] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-b1e7a07c-4ad7-4781-b0aa-47852020ec48" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.878677] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-b1e7a07c-4ad7-4781-b0aa-47852020ec48" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.878980] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-b1e7a07c-4ad7-4781-b0aa-47852020ec48" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.879133] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1e7a07c-4ad7-4781-b0aa-47852020ec48',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.038676] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.189468] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.282237] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.381957] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.382294] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.382514] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.382812] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.382969] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.383150] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port b1e7a07c-4ad7-4781-b0aa-47852020ec48 not found, creating... [ 825.383426] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.383606] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.383907] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.384149] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.384291] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.384578] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.384854] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.384854] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.385101] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.385242] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.385385] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: b1e7a07c-4ad7-4781-b0aa-47852020ec48 is going to be created. [ 825.406015] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.406223] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.406427] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.406686] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.406912] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.407142] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-b1e7a07c-4ad7-4781-b0aa-47852020ec48" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.541545] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.692174] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.786082] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.043586] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.043883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.043883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.044119] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.044338] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.044338] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 is going to be updated. [ 826.073223] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.073375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.073444] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.073667] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.073808] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.084534] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 in Status: IN_PROGRESS for 2s [ 826.097652] env[69559]: INFO networking_nsxv3.common.synchronization [req-bb671b6f-f784-4409-bc2f-5fad7a495089 req-3b2d2084-1b7b-4ea7-821d-d551068145f3 service nova] Enqueued Resource ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 with Priority: HIGHEST for action security_group_rules [ 826.097832] env[69559]: INFO networking_nsxv3.common.synchronization [req-bb671b6f-f784-4409-bc2f-5fad7a495089 req-3b2d2084-1b7b-4ea7-821d-d551068145f3 service nova] Enqueued Resource ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 with Priority: HIGHEST for action security_group_members [ 826.097966] env[69559]: INFO networking_nsxv3.common.synchronization [req-bb671b6f-f784-4409-bc2f-5fad7a495089 req-3b2d2084-1b7b-4ea7-821d-d551068145f3 service nova] Enqueued Resource ID: b1e7a07c-4ad7-4781-b0aa-47852020ec48 with Priority: HIGHEST for action port [ 826.098223] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 with Priority: HIGHEST for action security_group_rules [ 826.098354] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 with Priority: HIGHEST for action security_group_members [ 826.098469] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1e7a07c-4ad7-4781-b0aa-47852020ec48 with Priority: HIGHEST for action port [ 826.099021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.099261] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.099261] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.100284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.100381] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.101203] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.101303] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.101486] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1e7a07c-4ad7-4781-b0aa-47852020ec48 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.101576] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1e7a07c-4ad7-4781-b0aa-47852020ec48" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.101644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1e7a07c-4ad7-4781-b0aa-47852020ec48" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.101804] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1e7a07c-4ad7-4781-b0aa-47852020ec48" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.101865] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1e7a07c-4ad7-4781-b0aa-47852020ec48',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.195541] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 826.196044] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 826.289113] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.289282] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.289355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.289574] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.289684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.289779] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 is going to be updated. [ 826.322032] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.322032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.322032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.322032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.322032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.331746] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: IN_PROGRESS for 2s [ 826.603942] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.603942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.606455] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1e7a07c-4ad7-4781-b0aa-47852020ec48 with status ACTIVE [ 826.606556] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.607306] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.607306] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.607306] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.607306] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.607306] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.607306] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.607629] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.607629] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.607629] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.607779] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.607855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.607917] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.608073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.608186] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.608223] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1e7a07c-4ad7-4781-b0aa-47852020ec48 is going to be updated. [ 826.630620] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.630620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.630620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.630620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.630620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.630620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1e7a07c-4ad7-4781-b0aa-47852020ec48" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.040689] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.041220] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.041220] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.041220] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.055493] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 827.056897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.058404] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 827.083901] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.084080] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.084150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.084426] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.092095] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.092095] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 827.092095] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 827.092095] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 827.127943] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.127943] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.128210] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.128259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.135074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.135074] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 827.221743] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.222070] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.222761] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.224019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.224019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.224019] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 827.303872] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.303872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.303872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.303872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.303872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.303872] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:35. [ 827.303872] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'9bd39e16-65ec-4813-afc3-35754d24a5bf', '531bc278-c746-4ada-9fc4-704b99519eae', '89a65a81-7e5b-4da0-99ae-af95bd9df589', 'f6bb8723-4212-49f6-9e0f-6762cf861cbe', 'acb5a9fe-3650-403a-90f4-19ec52b5f97e', '734f0202-8a2d-48a6-8b16-336653a0c857', 'e657c0bf-1532-4777-b875-72ff585a9315', '8f7f9d2e-64a3-4672-969a-45f64c5621d1', '73004faf-0413-4eab-8656-b74e62d17245', '5761d173-f944-495b-b5eb-da227deec9b9', '1068186a-ec83-4273-b088-3f5610ae229e', '858bd0a1-9ee5-49c8-ac77-f218758ad913', 'fb31ec23-00b3-411e-81c7-83cd3eaa45d8', '162b0750-9392-4d6d-b97a-5ce01d5e0894', '4c0b6c4f-ae6a-4f68-8883-90c34a375fc7', '38ad73d3-d173-4ff2-9e1d-72777311ba4d', '73e98fb7-5118-4cdb-830b-497719ecfad4', '392028d0-93e9-4420-8ca7-d3fa218b5c83', '99092389-59da-4e36-9a78-d2e1e7edec3e', '39b15e36-c638-4ca0-a065-67c76e8f79fe', 'cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6', '55a5191b-a436-4df6-a235-6b2c46e6eea7', '825fa80b-a9de-4b97-ae04-49c19c2e9faa', '40991716-c8be-41b4-b8c7-a3774f7dac8e', '839ae40b-5f13-4259-8e2a-b943b206557d', '7fab5e96-3f01-4c71-994f-69059ca62986', '039c805f-b0b4-4b54-b42e-9f95c1e21442', 'a4e0cfba-8016-40f3-90aa-98a94645d23c', 'dbe866c5-e7b8-4862-b37c-6b17f875f07e', 'e2d4f121-303e-4c6b-ac7a-e595df5750d8', '7d3ab8f7-3874-4370-9e84-4a90ecd908d1', 'c225ff1a-79ed-4da1-ac55-3b8ee41f70a5', '71804139-4bc8-4998-a537-3cd9da947efb', '54038215-926d-4af7-820c-4eb952c9aac0', 'b5e555cc-4bc4-4e59-b77f-deda078818fb'} {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 827.303872] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 827.322985] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.322985] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.322985] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.322985] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.322985] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.322985] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 827.322985] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 827.322985] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 827.384659] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.384778] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.384838] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.385057] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.385764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.385971] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 827.386844] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 827.386909] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 827.386989] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 827.387085] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/35 resources of Type:Security Group Rules [ 827.387159] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf with Priority: HIGH for action security_group_rules [ 827.387237] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGH for action security_group_rules [ 827.387311] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 with Priority: HIGH for action security_group_rules [ 827.387387] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe with Priority: HIGH for action security_group_rules [ 827.387457] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e with Priority: HIGH for action security_group_rules [ 827.389076] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 734f0202-8a2d-48a6-8b16-336653a0c857 with Priority: HIGH for action security_group_rules [ 827.389076] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e657c0bf-1532-4777-b875-72ff585a9315 with Priority: HIGH for action security_group_rules [ 827.389076] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 with Priority: HIGH for action security_group_rules [ 827.389076] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 73004faf-0413-4eab-8656-b74e62d17245 with Priority: HIGH for action security_group_rules [ 827.389076] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5761d173-f944-495b-b5eb-da227deec9b9 with Priority: HIGH for action security_group_rules [ 827.389076] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGH for action security_group_rules [ 827.389076] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 with Priority: HIGH for action security_group_rules [ 827.389076] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 with Priority: HIGH for action security_group_rules [ 827.389076] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 with Priority: HIGH for action security_group_rules [ 827.389076] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 with Priority: HIGH for action security_group_rules [ 827.389076] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGH for action security_group_rules [ 827.389076] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 with Priority: HIGH for action security_group_rules [ 827.389076] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGH for action security_group_rules [ 827.389076] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 99092389-59da-4e36-9a78-d2e1e7edec3e with Priority: HIGH for action security_group_rules [ 827.389076] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe with Priority: HIGH for action security_group_rules [ 827.389076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.094597] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 in Status: SUCCESS [ 828.094930] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.095018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.095257] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.095473] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.095589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.095647] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.095862] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.095993] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.096142] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.342533] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: SUCCESS [ 828.342661] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.342864] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.343077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.343284] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.343428] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.343490] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.343593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.343667] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.343770] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.343889] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.599426] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.846521] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.846711] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.846777] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.846994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.847182] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.847294] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.847357] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.847502] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.847589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.847672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.847811] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.847902] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.847960] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.848118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.848265] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.848405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.848504] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.848612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.848708] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.848761] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.848938] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.101443] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.226183] env[69559]: INFO networking_nsxv3.common.synchronization [None req-3f25ceba-eca7-4183-840d-b32a51db6d46 None None] Enqueued Resource ID: 0b40f1c3-2a19-4d8e-bd6a-091b57dac116 with Priority: HIGHEST for action port [ 829.227159] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b40f1c3-2a19-4d8e-bd6a-091b57dac116 with Priority: HIGHEST for action port [ 829.227159] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf with Priority: HIGH for action security_group_rules [ 829.227159] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 with Priority: HIGH for action security_group_rules [ 829.227159] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e657c0bf-1532-4777-b875-72ff585a9315 with Priority: HIGH for action security_group_rules [ 829.227159] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 with Priority: HIGH for action security_group_rules [ 829.227159] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe with Priority: HIGH for action security_group_rules [ 829.227159] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99092389-59da-4e36-9a78-d2e1e7edec3e with Priority: HIGH for action security_group_rules [ 829.227159] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGH for action security_group_rules [ 829.227721] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 with Priority: HIGH for action security_group_rules [ 829.227721] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 with Priority: HIGH for action security_group_rules [ 829.227721] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGH for action security_group_rules [ 829.227721] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 with Priority: HIGH for action security_group_rules [ 829.227721] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 with Priority: HIGH for action security_group_rules [ 829.227721] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGH for action security_group_rules [ 829.229263] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5761d173-f944-495b-b5eb-da227deec9b9 with Priority: HIGH for action security_group_rules [ 829.229263] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73004faf-0413-4eab-8656-b74e62d17245 with Priority: HIGH for action security_group_rules [ 829.229263] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 734f0202-8a2d-48a6-8b16-336653a0c857 with Priority: HIGH for action security_group_rules [ 829.229263] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 with Priority: HIGH for action security_group_rules [ 829.229263] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e with Priority: HIGH for action security_group_rules [ 829.229263] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGH for action security_group_rules [ 829.229263] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe with Priority: HIGH for action security_group_rules [ 829.229928] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b40f1c3-2a19-4d8e-bd6a-091b57dac116 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.230074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b40f1c3-2a19-4d8e-bd6a-091b57dac116" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.230142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b40f1c3-2a19-4d8e-bd6a-091b57dac116" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.230466] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b40f1c3-2a19-4d8e-bd6a-091b57dac116" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.230549] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b40f1c3-2a19-4d8e-bd6a-091b57dac116',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.231609] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9bd39e16-65ec-4813-afc3-35754d24a5bf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.231749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.231847] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.232060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.232140] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9bd39e16-65ec-4813-afc3-35754d24a5bf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.233180] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89a65a81-7e5b-4da0-99ae-af95bd9df589 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.236342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.236342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.236342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.236342] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89a65a81-7e5b-4da0-99ae-af95bd9df589',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.236342] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e657c0bf-1532-4777-b875-72ff585a9315 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.236342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.236342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.236342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.236342] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e657c0bf-1532-4777-b875-72ff585a9315',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.236342] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.236342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.236342] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39b15e36-c638-4ca0-a065-67c76e8f79fe taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.236342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.236342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.236342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.236342] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39b15e36-c638-4ca0-a065-67c76e8f79fe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.237983] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99092389-59da-4e36-9a78-d2e1e7edec3e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.237983] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.237983] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.237983] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.237983] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99092389-59da-4e36-9a78-d2e1e7edec3e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.238622] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.238699] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.238753] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.238975] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.238975] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.239791] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73e98fb7-5118-4cdb-830b-497719ecfad4 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.240020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.240020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.241083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.241189] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.241990] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-162b0750-9392-4d6d-b97a-5ce01d5e0894 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.242108] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.242177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.242325] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.242506] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('162b0750-9392-4d6d-b97a-5ce01d5e0894',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.242687] env[69559]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 829.243916] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.244049] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.244115] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.244239] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.244310] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.245875] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb31ec23-00b3-411e-81c7-83cd3eaa45d8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.245875] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.245875] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.245875] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.245875] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb31ec23-00b3-411e-81c7-83cd3eaa45d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.246550] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-858bd0a1-9ee5-49c8-ac77-f218758ad913 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.246550] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.248212] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.248212] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.248212] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('858bd0a1-9ee5-49c8-ac77-f218758ad913',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.248212] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1068186a-ec83-4273-b088-3f5610ae229e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.248686] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.248686] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.248686] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.248686] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.250498] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5761d173-f944-495b-b5eb-da227deec9b9 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.250498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.250498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.250498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.250498] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5761d173-f944-495b-b5eb-da227deec9b9',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.251924] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73004faf-0413-4eab-8656-b74e62d17245 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.251924] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.251924] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.251924] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.251924] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73004faf-0413-4eab-8656-b74e62d17245',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.252166] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-734f0202-8a2d-48a6-8b16-336653a0c857 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.252254] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.252321] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.252504] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.252552] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.253320] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f7f9d2e-64a3-4672-969a-45f64c5621d1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.253430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.253496] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.253645] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.253717] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f7f9d2e-64a3-4672-969a-45f64c5621d1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.254915] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.255035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.255080] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.255386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.255470] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acb5a9fe-3650-403a-90f4-19ec52b5f97e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.256273] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-531bc278-c746-4ada-9fc4-704b99519eae taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.256394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.256460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.256652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.257040] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.257384] env[69559]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 829.258311] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6bb8723-4212-49f6-9e0f-6762cf861cbe taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.258431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.258777] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.258965] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.259097] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6bb8723-4212-49f6-9e0f-6762cf861cbe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.262093] env[69559]: INFO networking_nsxv3.common.synchronization [req-650027ab-c941-4ee5-8c24-346ad0f3a973 req-b792416e-e243-4f04-b657-5cd3f71a2df6 tempest-DeleteServersTestJSON-1423597435 tempest-DeleteServersTestJSON-1423597435-project-member] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 829.269908] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bd39e16-65ec-4813-afc3-35754d24a5bf taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.269908] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.269908] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.269908] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.269908] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.269908] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.269908] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.270613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.270613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.270613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.270613] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9bd39e16-65ec-4813-afc3-35754d24a5bf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.271559] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b40f1c3-2a19-4d8e-bd6a-091b57dac116 [ 829.271559] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.271559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.271559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.271840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.271840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.271926] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b40f1c3-2a19-4d8e-bd6a-091b57dac116 already deleted. [ 829.271926] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b40f1c3-2a19-4d8e-bd6a-091b57dac116" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.272807] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 829.276882] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.276980] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.277044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.277219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.277901] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.277901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.277901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.277901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.277901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.277901] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.351151] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55a5191b-a436-4df6-a235-6b2c46e6eea7: rpc.has_security_group_logging(os_id): False [ 829.369735] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.369868] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.369941] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.370224] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.391275] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.391701] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.391838] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.391882] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.392154] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.392256] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.392494] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.392984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.392984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.393090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.393310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.393497] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.393628] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.393706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.396204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.396204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.396204] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 is going to be updated. [ 829.456459] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.456602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.456727] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.456898] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.457066] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.468663] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: IN_PROGRESS for 2s [ 829.603727] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.603895] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.603973] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.604212] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.604303] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.604400] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 is going to be updated. [ 829.630741] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.630741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.630741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.630948] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.631153] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.644103] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 in Status: IN_PROGRESS for 2s [ 829.764135] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-89a65a81-7e5b-4da0-99ae-af95bd9df589 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.764287] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.764333] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.764544] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.764713] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.764836] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.764887] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.765034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.765198] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.765198] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.765298] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('89a65a81-7e5b-4da0-99ae-af95bd9df589',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.775984] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9bd39e16-65ec-4813-afc3-35754d24a5bf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.784830] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.784830] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.784946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.785065] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.801135] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.801214] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.801307] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.801426] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.801589] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.801704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.801739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.801880] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.801964] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.802056] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.802140] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.803682] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-596 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.803869] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.804037] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.805051] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.805051] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.805051] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.805051] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.805051] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.805323] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.805419] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.805510] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.805589] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.806042] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.806042] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.806042] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.806330] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.808068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.808255] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.808351] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.808414] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.810468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.810468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.810468] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be updated. [ 829.810468] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-73e98fb7-5118-4cdb-830b-497719ecfad4 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.810468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.810468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.810468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.810468] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.810912] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.810912] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.810912] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.810912] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.810912] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.810912] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.811723] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-39b15e36-c638-4ca0-a065-67c76e8f79fe taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.811857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.811911] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.812044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.812183] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.812273] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.812332] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.812469] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.812541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.812618] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.813328] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39b15e36-c638-4ca0-a065-67c76e8f79fe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.813677] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-162b0750-9392-4d6d-b97a-5ce01d5e0894 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.813677] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.813677] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.813805] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.813865] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.813932] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.813991] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.817172] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.817268] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.819201] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.819201] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('162b0750-9392-4d6d-b97a-5ce01d5e0894',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.820055] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-734f0202-8a2d-48a6-8b16-336653a0c857 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.820183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.820270] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.820467] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.820661] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.820791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.820863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.821028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.821108] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.821209] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.821317] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.827339] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-acb5a9fe-3650-403a-90f4-19ec52b5f97e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.827339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.827339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.827339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.827339] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.828956] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.829060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.829264] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.829349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.829447] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.829539] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('acb5a9fe-3650-403a-90f4-19ec52b5f97e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.832232] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-1068186a-ec83-4273-b088-3f5610ae229e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.832351] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.832414] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.832598] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.832731] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.832822] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.832880] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.833119] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.833207] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.833287] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.833366] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.836419] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-99092389-59da-4e36-9a78-d2e1e7edec3e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.836600] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.836600] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.836784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.836914] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.837053] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.837183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.837261] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.837387] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.837421] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.837487] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99092389-59da-4e36-9a78-d2e1e7edec3e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.841250] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-38ad73d3-d173-4ff2-9e1d-72777311ba4d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.841404] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.841471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.841644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.841795] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.841896] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.841938] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.842094] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.842172] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.842256] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.842515] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.843338] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-531bc278-c746-4ada-9fc4-704b99519eae taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.843338] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.843338] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.843510] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.843996] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.843996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.843996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.843996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.843996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.843996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.844252] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.846153] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-858bd0a1-9ee5-49c8-ac77-f218758ad913 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.846275] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.846341] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.846552] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.846774] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.848118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.848118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.848118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.848118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.848118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.848314] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('858bd0a1-9ee5-49c8-ac77-f218758ad913',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.849753] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39b15e36-c638-4ca0-a065-67c76e8f79fe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.884341] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.884522] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.884596] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.884820] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.887231] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.887231] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.889853] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.890024] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.084 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 829.890172] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.890349] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.890654] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-443fd8a9-80a2-4b80-9dd4-8bb08f407418 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.890822] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-443fd8a9-80a2-4b80-9dd4-8bb08f407418" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.891086] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-443fd8a9-80a2-4b80-9dd4-8bb08f407418" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.891362] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-443fd8a9-80a2-4b80-9dd4-8bb08f407418" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.891510] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('443fd8a9-80a2-4b80-9dd4-8bb08f407418',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.894539] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.894539] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.894673] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.894718] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.895397] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.895487] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.897876] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.897876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.906606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.906727] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb31ec23-00b3-411e-81c7-83cd3eaa45d8 is going to be deleted. [ 829.908108] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.908347] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.914163] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.914301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.914387] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.915017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.915017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.924108] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 829.936967] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.937159] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f7f9d2e-64a3-4672-969a-45f64c5621d1 is going to be deleted. [ 829.939238] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.939238] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.957813] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.958071] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5761d173-f944-495b-b5eb-da227deec9b9 is going to be deleted. [ 829.962138] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.962138] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.977781] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.977781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.979809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.979991] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6bb8723-4212-49f6-9e0f-6762cf861cbe is going to be deleted. [ 829.980926] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.981193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.017916] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.017916] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.017916] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.018073] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e657c0bf-1532-4777-b875-72ff585a9315 is going to be deleted. [ 830.018967] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.019405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.056919] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.057099] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73004faf-0413-4eab-8656-b74e62d17245 is going to be deleted. [ 830.058064] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.058276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.058362] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.058590] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb31ec23-00b3-411e-81c7-83cd3eaa45d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.058787] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.058970] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.059073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.059197] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f7f9d2e-64a3-4672-969a-45f64c5621d1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.071873] env[69559]: INFO networking_nsxv3.common.synchronization [None req-d96ff78a-694d-48f1-bcaa-06f6e7001b80 tempest-AttachVolumeNegativeTest-1400300488 tempest-AttachVolumeNegativeTest-1400300488-project-member] Enqueued Resource ID: 362fb317-5783-4d37-bba5-4e590ce7111d with Priority: HIGHEST for action security_group_rules [ 830.072701] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.072832] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.072895] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.073223] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.073313] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.073461] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5761d173-f944-495b-b5eb-da227deec9b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.073867] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 362fb317-5783-4d37-bba5-4e590ce7111d with Priority: HIGHEST for action security_group_rules [ 830.074818] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-362fb317-5783-4d37-bba5-4e590ce7111d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.074818] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.074818] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.074818] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.074818] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('362fb317-5783-4d37-bba5-4e590ce7111d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.079597] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.079799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.079904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.080162] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.080276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.080397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6bb8723-4212-49f6-9e0f-6762cf861cbe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.102482] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.102867] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.102867] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.103173] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.103409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.103967] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e657c0bf-1532-4777-b875-72ff585a9315" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.142068] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.142405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.142567] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.142886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.143069] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.143244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73004faf-0413-4eab-8656-b74e62d17245" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.171678] env[69559]: INFO networking_nsxv3.common.synchronization [None req-33778f30-ed75-4a33-8738-baa13c7eedf6 tempest-AttachVolumeNegativeTest-1400300488 tempest-AttachVolumeNegativeTest-1400300488-project-member] Enqueued Resource ID: 362fb317-5783-4d37-bba5-4e590ce7111d with Priority: HIGHEST for action security_group_rules [ 830.171678] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 362fb317-5783-4d37-bba5-4e590ce7111d with Priority: HIGHEST for action security_group_rules [ 830.171678] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-362fb317-5783-4d37-bba5-4e590ce7111d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.171678] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.268482] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-89a65a81-7e5b-4da0-99ae-af95bd9df589 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.269723] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.269723] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.269723] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.269723] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.269723] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.269723] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.270063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.270063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.270063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.270063] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-89a65a81-7e5b-4da0-99ae-af95bd9df589 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.270237] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.270237] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.270340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.270478] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.270570] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.270671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.270780] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.270836] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.270912] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.271014] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('89a65a81-7e5b-4da0-99ae-af95bd9df589',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.279380] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9bd39e16-65ec-4813-afc3-35754d24a5bf: rpc.has_security_group_logging(os_id): False [ 830.310267] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.310267] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.310267] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.310267] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.310738] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.310914] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.310914] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.312597] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.312850] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.312970] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.313058] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.313235] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.313324] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.313414] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.317022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.317022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.317022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.317022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.317022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.317022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.317022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.317022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.317022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.317022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.317022] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.347922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.348278] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.348405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.348672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.348780] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.348866] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.348958] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf is going to be updated. [ 830.352797] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('162b0750-9392-4d6d-b97a-5ce01d5e0894',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.352797] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99092389-59da-4e36-9a78-d2e1e7edec3e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.356771] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.357479] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.358396] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-734f0202-8a2d-48a6-8b16-336653a0c857 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.358396] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.358396] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.358632] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.359977] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.359977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.359977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.359977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.359977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.359977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.359977] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-734f0202-8a2d-48a6-8b16-336653a0c857 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.359977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.359977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.359977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.359977] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.359977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.359977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.360577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.360577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.360577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.360577] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.365114] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.366237] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('acb5a9fe-3650-403a-90f4-19ec52b5f97e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.366846] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.368861] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('858bd0a1-9ee5-49c8-ac77-f218758ad913',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.369449] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39b15e36-c638-4ca0-a065-67c76e8f79fe: rpc.has_security_group_logging(os_id): False [ 830.387908] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.388682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.388682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.388816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.395387] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.395387] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.395387] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.395636] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.395789] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.395950] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 443fd8a9-80a2-4b80-9dd4-8bb08f407418 not found, creating... [ 830.396245] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.396424] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.396541] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.396784] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.396931] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.397238] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.397955] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.397955] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.397955] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.397955] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.398260] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 443fd8a9-80a2-4b80-9dd4-8bb08f407418 is going to be created. [ 830.409029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.409650] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.409650] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.409650] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.409650] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.410021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.410021] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe is going to be updated. [ 830.418280] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.418534] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.418696] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.418986] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.419252] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.419565] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-443fd8a9-80a2-4b80-9dd4-8bb08f407418" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.453064] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.453243] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.453315] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.453539] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.453684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.475177] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.475177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.475177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.475177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.475177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.482016] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf in Status: IN_PROGRESS for 2s [ 830.488220] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe in Status: IN_PROGRESS for 2s [ 830.613326] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.613606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.613606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.613893] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.613893] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.614132] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 362fb317-5783-4d37-bba5-4e590ce7111d already deleted. [ 830.614132] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.614257] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.614380] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.614475] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('362fb317-5783-4d37-bba5-4e590ce7111d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.775792] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 89a65a81-7e5b-4da0-99ae-af95bd9df589: rpc.has_security_group_logging(os_id): False [ 830.792597] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.792809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.792809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.793301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.810457] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.810798] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.810926] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.810993] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.811194] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.811291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.811513] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.811592] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.811655] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.811806] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.811952] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.812079] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.812172] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.812243] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.812381] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.812468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.812802] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 is going to be updated. [ 830.819277] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 392028d0-93e9-4420-8ca7-d3fa218b5c83: rpc.has_security_group_logging(os_id): False [ 830.835171] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.835298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.835928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.836179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.856548] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.857873] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.857873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.857873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.857873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.857873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.857873] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.857873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.857873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.858405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.858405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.858405] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.858405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.858610] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.858610] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.858708] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.858830] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 is going to be updated. [ 830.866084] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 734f0202-8a2d-48a6-8b16-336653a0c857: rpc.has_security_group_logging(os_id): False [ 830.868166] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1068186a-ec83-4273-b088-3f5610ae229e: rpc.has_security_group_logging(os_id): False [ 830.868942] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99092389-59da-4e36-9a78-d2e1e7edec3e: rpc.has_security_group_logging(os_id): False [ 830.870419] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 162b0750-9392-4d6d-b97a-5ce01d5e0894: rpc.has_security_group_logging(os_id): False [ 830.871014] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38ad73d3-d173-4ff2-9e1d-72777311ba4d: rpc.has_security_group_logging(os_id): False [ 830.872012] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 73e98fb7-5118-4cdb-830b-497719ecfad4: rpc.has_security_group_logging(os_id): False [ 830.872875] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for acb5a9fe-3650-403a-90f4-19ec52b5f97e: rpc.has_security_group_logging(os_id): False [ 830.874367] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 531bc278-c746-4ada-9fc4-704b99519eae: rpc.has_security_group_logging(os_id): False [ 830.879206] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 858bd0a1-9ee5-49c8-ac77-f218758ad913: rpc.has_security_group_logging(os_id): False [ 830.890354] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.890526] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.890591] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.890768] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.890910] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.915475] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.915813] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.915813] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.915986] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.917693] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.917864] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.918867] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.919020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.919772] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.920051] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.920729] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.920938] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.921635] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.921737] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.922811] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.922811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.937204] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.937321] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.954022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.954221] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.955218] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.955353] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.960333] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 in Status: IN_PROGRESS for 2s [ 830.961058] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 830.961628] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.961807] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.961927] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.962010] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.962257] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.962360] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.962526] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 is going to be updated. [ 830.963504] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.963679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.007054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.007054] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.007054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.007054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.007349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.007349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.007546] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.007651] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.007732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.007959] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.008082] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.008294] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.008424] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.008576] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.008743] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.008837] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.008975] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 734f0202-8a2d-48a6-8b16-336653a0c857 is going to be updated. [ 831.010180] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.010354] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.047467] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.047794] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.047912] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.047971] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.048187] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.048272] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.048368] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 531bc278-c746-4ada-9fc4-704b99519eae is going to be updated. [ 831.049663] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.051819] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.089031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.089031] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.089031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.089031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.089031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.089031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.089031] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99092389-59da-4e36-9a78-d2e1e7edec3e is going to be updated. [ 831.089442] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.089735] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.107724] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.107724] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.121025] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.121025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.131516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.131516] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.131516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.131516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.131516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.131516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.131516] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d is going to be updated. [ 831.132452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.132810] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.179022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.179022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.179022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.179022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.184019] env[69559]: INFO networking_nsxv3.common.synchronization [req-ff4ed0f0-6969-4ef4-8f28-10b9f94a17cc req-3319d69f-9d47-43b2-8822-696d48312a99 tempest-InstanceActionsTestJSON-789845982 tempest-InstanceActionsTestJSON-789845982-project-member] Enqueued Resource ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 with Priority: HIGHEST for action security_group_members [ 831.184019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.184019] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.184019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.184019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.184019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.184019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.184019] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e is going to be updated. [ 831.185056] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 with Priority: HIGHEST for action security_group_members [ 831.185405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.185671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.186983] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-89a65a81-7e5b-4da0-99ae-af95bd9df589 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.187236] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.187404] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.187641] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.187897] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.188133] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.188286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.188672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.190336] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.190588] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89a65a81-7e5b-4da0-99ae-af95bd9df589',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.227664] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.228290] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.254169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.254169] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.254169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.254169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.254169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.254169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.254169] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 is going to be updated. [ 831.258547] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.258898] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.332367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.333165] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.335029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.335029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.335029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.335029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.335029] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1068186a-ec83-4273-b088-3f5610ae229e is going to be updated. [ 831.337062] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.337480] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.337844] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.341023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.341023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.344170] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.346921] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.373650] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.373831] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.381406] env[69559]: INFO networking_nsxv3.common.synchronization [req-650027ab-c941-4ee5-8c24-346ad0f3a973 req-857ae7e9-0b45-47d0-a6f6-14d86cbbdb07 service nova] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_rules [ 831.381567] env[69559]: INFO networking_nsxv3.common.synchronization [req-650027ab-c941-4ee5-8c24-346ad0f3a973 req-857ae7e9-0b45-47d0-a6f6-14d86cbbdb07 service nova] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 831.381914] env[69559]: INFO networking_nsxv3.common.synchronization [req-650027ab-c941-4ee5-8c24-346ad0f3a973 req-857ae7e9-0b45-47d0-a6f6-14d86cbbdb07 service nova] Enqueued Resource ID: 443fd8a9-80a2-4b80-9dd4-8bb08f407418 with Priority: HIGHEST for action port [ 831.382037] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_rules [ 831.382143] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 831.382241] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 443fd8a9-80a2-4b80-9dd4-8bb08f407418 with Priority: HIGHEST for action port [ 831.383029] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.383029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.383408] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.383573] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.383573] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.384428] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.384514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.384779] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-443fd8a9-80a2-4b80-9dd4-8bb08f407418 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.384779] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-443fd8a9-80a2-4b80-9dd4-8bb08f407418" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.385020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-443fd8a9-80a2-4b80-9dd4-8bb08f407418" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.385020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-443fd8a9-80a2-4b80-9dd4-8bb08f407418" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.385146] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('443fd8a9-80a2-4b80-9dd4-8bb08f407418',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.391422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.391422] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.391597] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.391597] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.391726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.391807] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.391908] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 is going to be updated. [ 831.392914] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.393093] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.393232] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.394123] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.394662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.394662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.395844] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 in Status: IN_PROGRESS for 2s [ 831.396735] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.396867] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.397156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.401441] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.401546] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.402495] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.402772] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.402843] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.403994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.407712] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.408213] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.409183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.409353] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.409484] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.410924] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.411102] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.411171] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.411301] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 362fb317-5783-4d37-bba5-4e590ce7111d already deleted. [ 831.411301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.411894] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.411894] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.412023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.444312] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 in Status: IN_PROGRESS for 2s [ 831.445388] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d in Status: IN_PROGRESS for 2s [ 831.465146] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: SUCCESS [ 831.465146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.466725] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 734f0202-8a2d-48a6-8b16-336653a0c857 in Status: IN_PROGRESS for 2s [ 831.468133] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99092389-59da-4e36-9a78-d2e1e7edec3e in Status: IN_PROGRESS for 2s [ 831.468265] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 531bc278-c746-4ada-9fc4-704b99519eae in Status: IN_PROGRESS for 2s [ 831.471192] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e in Status: IN_PROGRESS for 2s [ 831.487732] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: SUCCESS [ 831.487961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.498789] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.498929] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.498999] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.499228] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.499371] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.541058] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1068186a-ec83-4273-b088-3f5610ae229e in Status: IN_PROGRESS for 2s [ 831.580672] env[69559]: INFO networking_nsxv3.common.synchronization [None req-ed9ebebb-436f-4a8c-bace-cb7de6b44e99 None None] Enqueued Resource ID: 6f326602-79b9-4fa5-ac10-e6aa6edf42af with Priority: HIGHEST for action port [ 831.582525] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f326602-79b9-4fa5-ac10-e6aa6edf42af with Priority: HIGHEST for action port [ 831.582525] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f326602-79b9-4fa5-ac10-e6aa6edf42af taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.582525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f326602-79b9-4fa5-ac10-e6aa6edf42af" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.582525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f326602-79b9-4fa5-ac10-e6aa6edf42af" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.582864] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f326602-79b9-4fa5-ac10-e6aa6edf42af" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.582969] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f326602-79b9-4fa5-ac10-e6aa6edf42af',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.596156] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.596302] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.596394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.596619] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.596759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.639095] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 in Status: IN_PROGRESS for 2s [ 831.649094] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 in Status: SUCCESS [ 831.650028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.650028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.650028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.650324] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.651757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.651757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.651757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.651757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.651757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.652807] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.694470] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.694701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.694788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.695013] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.695112] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.695314] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.695432] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.695495] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.695656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.695732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.695817] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 is going to be updated. [ 831.734160] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.734351] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.734635] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.734635] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.734776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.744844] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 in Status: IN_PROGRESS for 2s [ 831.886844] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.886968] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.891040] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 443fd8a9-80a2-4b80-9dd4-8bb08f407418 with status ACTIVE [ 831.891561] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.891782] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.891895] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.892168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.892294] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.892543] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.892696] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.892794] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.892997] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.893319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.893570] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.893748] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.893820] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.893976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.894057] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.894153] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 443fd8a9-80a2-4b80-9dd4-8bb08f407418 is going to be updated. [ 831.916247] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.916455] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.916507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.916697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.916831] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.916996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-443fd8a9-80a2-4b80-9dd4-8bb08f407418" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.933424] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 831.933546] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d deletion is rescheduled due to dependency. [ 831.933587] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.933719] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.934018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.934147] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.934287] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.934956] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.934956] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.934956] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.934956] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.086205] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f326602-79b9-4fa5-ac10-e6aa6edf42af [ 832.086205] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.086205] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.086205] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.086205] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.086205] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.086205] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f326602-79b9-4fa5-ac10-e6aa6edf42af already deleted. [ 832.086205] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f326602-79b9-4fa5-ac10-e6aa6edf42af" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.155056] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.155432] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.155432] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.155589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.155660] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.155827] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.155920] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.156050] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.156139] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.156226] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.156374] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.156495] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.156656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.156656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.156930] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.156930] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.156930] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.157163] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.157163] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.157264] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.157383] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.438042] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.492431] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf in Status: SUCCESS [ 832.492584] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.496955] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe in Status: SUCCESS [ 832.497180] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.660040] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7: rpc.has_security_group_logging(os_id): False [ 832.680063] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.680063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.680063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.680063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.701075] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.701413] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.701640] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.701700] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.701961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.702600] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.702600] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.702600] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.702600] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.702937] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.702973] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.704291] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.704291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.704291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.704291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.704291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.704291] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 is going to be updated. [ 832.761179] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.762094] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.762094] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.762094] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.762094] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.775040] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 in Status: IN_PROGRESS for 2s [ 832.942541] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.973145] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 in Status: SUCCESS [ 832.973484] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.407360] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 in Status: SUCCESS [ 833.407622] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.445296] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.445536] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.445649] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.445883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.446014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.446131] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be updated. [ 833.466144] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d in Status: SUCCESS [ 833.466375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.466698] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 in Status: SUCCESS [ 833.466862] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.481352] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.481352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.481470] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.481564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.481695] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.483123] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 734f0202-8a2d-48a6-8b16-336653a0c857 in Status: SUCCESS [ 833.483312] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.483961] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99092389-59da-4e36-9a78-d2e1e7edec3e in Status: SUCCESS [ 833.484146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.485015] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 531bc278-c746-4ada-9fc4-704b99519eae in Status: SUCCESS [ 833.485194] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.485849] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e in Status: SUCCESS [ 833.486030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.492595] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 833.557111] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1068186a-ec83-4273-b088-3f5610ae229e in Status: SUCCESS [ 833.557368] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.654776] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 in Status: SUCCESS [ 833.655080] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.756999] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 in Status: SUCCESS [ 833.756999] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 deletion is rescheduled due to dependency. [ 833.756999] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.428229] env[69559]: INFO networking_nsxv3.common.synchronization [req-d87c49df-c795-4599-b879-8c7ed9e95464 req-50eceeb4-1ddd-4b4b-8df5-a22ff22085ae tempest-ServersTestMultiNic-1711850925 tempest-ServersTestMultiNic-1711850925-project-member] Enqueued Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 834.428795] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 834.429142] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.429283] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.429587] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.429587] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.429753] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.429852] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.429913] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.430085] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.430174] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.430269] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.787980] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 in Status: SUCCESS [ 834.788226] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.788419] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.788689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.788795] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.932475] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.932636] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.932707] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.932943] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.953543] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.955130] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.955283] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.955353] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.955574] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.955660] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.955753] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e is going to be updated. [ 834.961577] env[69559]: INFO networking_nsxv3.common.synchronization [req-d87c49df-c795-4599-b879-8c7ed9e95464 req-ddab44bf-4b19-4b07-bc36-379f000c4fc4 tempest-ServersTestMultiNic-1711850925 tempest-ServersTestMultiNic-1711850925-project-member] Enqueued Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 834.962830] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 834.962830] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.962830] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.977353] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.978418] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.978418] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.978418] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.978736] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.987962] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: IN_PROGRESS for 2s [ 835.291594] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.291819] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.291941] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.292225] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.292458] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.292602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.292691] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.292926] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.293097] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.293209] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.293360] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.391420] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-462 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.391420] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-462" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.391420] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-462" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.391420] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-462" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.391420] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.391685] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.391728] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.391921] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.392272] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.392511] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.392645] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 835.392939] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 835.393074] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 835.393194] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.393305] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 835.393442] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 835.410413] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 835.410583] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 835.410728] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 835.410906] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-462" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.411235] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-02dff0af-6e51-4875-ae35-34afbc503374 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.411412] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-02dff0af-6e51-4875-ae35-34afbc503374" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.411535] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-02dff0af-6e51-4875-ae35-34afbc503374" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.411842] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-02dff0af-6e51-4875-ae35-34afbc503374" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.412078] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02dff0af-6e51-4875-ae35-34afbc503374',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.503827] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 835.503827] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.504210] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.504210] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.504311] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.504404] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.504469] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.504637] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.504751] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.504802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.504847] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.798975] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.798975] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.798975] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.798975] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.799236] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.799236] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.799324] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.799451] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.799493] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.799556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.799700] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.799791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.799863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.799995] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.800133] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.800200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.800264] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.800387] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.800455] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.800532] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.800995] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.915947] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.915947] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.915947] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.916207] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.916336] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.916628] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 02dff0af-6e51-4875-ae35-34afbc503374 not found, creating... [ 835.916800] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.916973] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.917121] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.917811] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.917811] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.917811] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.918008] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.918100] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.918315] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.918469] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.919079] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 02dff0af-6e51-4875-ae35-34afbc503374 is going to be created. [ 835.937243] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.937455] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.937584] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.937945] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.938240] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.938828] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-02dff0af-6e51-4875-ae35-34afbc503374" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.986676] env[69559]: INFO networking_nsxv3.common.synchronization [req-d292f28f-5482-407c-91a0-c08d54530d2d req-02667f43-94f9-4b2c-96d2-48085c7590d9 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 with Priority: HIGHEST for action security_group_members [ 835.986844] env[69559]: INFO networking_nsxv3.common.synchronization [req-d292f28f-5482-407c-91a0-c08d54530d2d req-02667f43-94f9-4b2c-96d2-48085c7590d9 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 with Priority: HIGHEST for action security_group_members [ 835.986977] env[69559]: INFO networking_nsxv3.common.synchronization [req-d292f28f-5482-407c-91a0-c08d54530d2d req-02667f43-94f9-4b2c-96d2-48085c7590d9 tempest-SecurityGroupsTestJSON-620640531 tempest-SecurityGroupsTestJSON-620640531-project-member] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 835.987616] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 with Priority: HIGHEST for action security_group_members [ 835.987742] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 with Priority: HIGHEST for action security_group_members [ 835.987834] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGHEST for action security_group_members [ 835.988116] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-73e98fb7-5118-4cdb-830b-497719ecfad4 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.988232] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.988295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.988496] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.989060] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.989164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.989229] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.989387] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.989473] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.989592] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.994032] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-162b0750-9392-4d6d-b97a-5ce01d5e0894 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.994032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.994032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.994032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.994032] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.994032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.994032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.994032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.994032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.994032] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('162b0750-9392-4d6d-b97a-5ce01d5e0894',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.994032] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.994032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.994032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.994032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.994032] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.994032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.994032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.994032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.994907] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.994907] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.006499] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.006653] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.006786] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.006983] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.007160] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.007258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.007322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.007594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.007688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.007825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.007923] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.008030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.008284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.008447] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.008640] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.008741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.008802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.008942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.009031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.009115] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.009203] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.306705] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7: rpc.has_security_group_logging(os_id): False [ 836.325020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.325020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.325020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.325020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.325020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.325020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.325020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.325020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.325020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.325020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.325020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.325020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.325020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.325020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.325020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.325672] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.325672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.325672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.325672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.326118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.326317] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 is going to be updated. [ 836.390870] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.390870] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.390870] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.390870] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.390870] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.401361] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 in Status: IN_PROGRESS for 2s [ 836.494642] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.494813] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.494887] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.495160] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.495289] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.495600] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.495600] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.495724] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.496277] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.496277] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.496277] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 is going to be updated. [ 836.497092] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.497192] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.497256] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.497473] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.497473] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.497644] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.497732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.497791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.497924] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.497994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.498083] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 is going to be updated. [ 836.499038] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.499146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.499190] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.499954] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.499954] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.499954] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.499954] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.499954] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.499954] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.499954] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.500321] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 is going to be updated. [ 836.511874] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 839ae40b-5f13-4259-8e2a-b943b206557d: rpc.has_security_group_logging(os_id): False [ 836.542620] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.542896] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.543032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.543341] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.543500] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.543848] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.544034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.544293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.544622] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.544772] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.545114] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.545260] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.545368] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.545663] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.545800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.546113] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.546577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.546701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.546931] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.547483] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.547483] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be updated. [ 836.563345] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.563485] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.563530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.563723] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.563855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.565500] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.565675] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.565675] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.565833] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.565952] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.572897] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.572897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.572897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.572897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.573647] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.577736] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: IN_PROGRESS for 2s [ 836.580195] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 in Status: IN_PROGRESS for 2s [ 836.586277] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 in Status: IN_PROGRESS for 2s [ 836.631602] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.631763] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.631834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.632061] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.632935] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.643581] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 836.751052] env[69559]: INFO networking_nsxv3.common.synchronization [req-d87c49df-c795-4599-b879-8c7ed9e95464 req-904b7201-38ab-4ecc-a78c-b792cafe1a71 service nova] Enqueued Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_rules [ 836.751297] env[69559]: INFO networking_nsxv3.common.synchronization [req-d87c49df-c795-4599-b879-8c7ed9e95464 req-904b7201-38ab-4ecc-a78c-b792cafe1a71 service nova] Enqueued Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 836.751394] env[69559]: INFO networking_nsxv3.common.synchronization [req-d87c49df-c795-4599-b879-8c7ed9e95464 req-904b7201-38ab-4ecc-a78c-b792cafe1a71 service nova] Enqueued Resource ID: 02dff0af-6e51-4875-ae35-34afbc503374 with Priority: HIGHEST for action port [ 836.751624] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_rules [ 836.751774] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 836.751837] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02dff0af-6e51-4875-ae35-34afbc503374 with Priority: HIGHEST for action port [ 836.752431] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.752493] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.752556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.754349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.754349] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.754349] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.754349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.754349] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-02dff0af-6e51-4875-ae35-34afbc503374 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.754349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02dff0af-6e51-4875-ae35-34afbc503374" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.754349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02dff0af-6e51-4875-ae35-34afbc503374" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.754709] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02dff0af-6e51-4875-ae35-34afbc503374" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.754709] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02dff0af-6e51-4875-ae35-34afbc503374',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.001122] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: SUCCESS [ 837.001897] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e deletion is rescheduled due to dependency. [ 837.001897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.001897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.001897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.002235] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.002235] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.002373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.002435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.002585] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.002680] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.256061] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.256212] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.257562] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02dff0af-6e51-4875-ae35-34afbc503374 with status ACTIVE [ 837.257758] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.257878] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.258016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.258168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.258259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.258431] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.258590] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.258663] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.258812] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.258886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.259087] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.259217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.259305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.259537] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.259699] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.259699] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02dff0af-6e51-4875-ae35-34afbc503374 is going to be updated. [ 837.281704] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.281890] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.282208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.282208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.282472] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.282472] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02dff0af-6e51-4875-ae35-34afbc503374" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.505484] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.596425] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-293 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.596710] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-293" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.596817] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-293" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.597176] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-293" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.597492] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.597705] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.597892] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.598173] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.598461] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.598630] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 837.598789] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 837.598934] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 837.599103] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 837.599298] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 837.599511] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 837.599673] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 837.617403] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 837.617403] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 837.617487] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 837.617595] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-293" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.617958] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-c189f0d9-5063-4311-a545-fc70d77f7c9d taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.618155] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-c189f0d9-5063-4311-a545-fc70d77f7c9d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.618285] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-c189f0d9-5063-4311-a545-fc70d77f7c9d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.618645] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-c189f0d9-5063-4311-a545-fc70d77f7c9d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.618795] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c189f0d9-5063-4311-a545-fc70d77f7c9d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.008354] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.124021] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.124021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.124021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.124021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.124021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.124021] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port c189f0d9-5063-4311-a545-fc70d77f7c9d not found, creating... [ 838.124021] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.124021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.124021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.124021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.124021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.124554] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.124554] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.124783] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.125116] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.125367] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.125613] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: c189f0d9-5063-4311-a545-fc70d77f7c9d is going to be created. [ 838.147893] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.147893] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.147893] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.147893] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.147893] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.147893] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-c189f0d9-5063-4311-a545-fc70d77f7c9d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.418028] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 in Status: SUCCESS [ 838.418028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.516447] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.516651] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.516726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.516949] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.517041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.517146] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e is going to be updated. [ 838.541534] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.541682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.541778] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.542024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.542157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.550409] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: IN_PROGRESS for 2s [ 838.589921] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 in Status: SUCCESS [ 838.590175] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 deletion is rescheduled due to dependency. [ 838.590315] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.591056] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 in Status: SUCCESS [ 838.593085] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 deletion is rescheduled due to dependency. [ 838.593192] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.598814] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 in Status: SUCCESS [ 838.599104] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 deletion is rescheduled due to dependency. [ 838.599645] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.656178] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 838.656423] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.974950] env[69559]: INFO networking_nsxv3.common.synchronization [req-d87c49df-c795-4599-b879-8c7ed9e95464 req-49b830f7-b8f4-42a3-aff0-524ef3b9bf0e service nova] Enqueued Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_rules [ 838.975052] env[69559]: INFO networking_nsxv3.common.synchronization [req-d87c49df-c795-4599-b879-8c7ed9e95464 req-49b830f7-b8f4-42a3-aff0-524ef3b9bf0e service nova] Enqueued Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 838.975162] env[69559]: INFO networking_nsxv3.common.synchronization [req-d87c49df-c795-4599-b879-8c7ed9e95464 req-49b830f7-b8f4-42a3-aff0-524ef3b9bf0e service nova] Enqueued Resource ID: c189f0d9-5063-4311-a545-fc70d77f7c9d with Priority: HIGHEST for action port [ 838.975402] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_rules [ 838.975530] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 838.975657] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c189f0d9-5063-4311-a545-fc70d77f7c9d with Priority: HIGHEST for action port [ 838.982669] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.982801] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.983051] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.983135] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.983324] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-c189f0d9-5063-4311-a545-fc70d77f7c9d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.983425] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c189f0d9-5063-4311-a545-fc70d77f7c9d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.983487] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c189f0d9-5063-4311-a545-fc70d77f7c9d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.983703] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c189f0d9-5063-4311-a545-fc70d77f7c9d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.983774] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c189f0d9-5063-4311-a545-fc70d77f7c9d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.485578] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c189f0d9-5063-4311-a545-fc70d77f7c9d with status ACTIVE [ 839.485829] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.485994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.486090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.486309] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.486453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.486677] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.486793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.486854] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.487030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.487112] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.487293] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.487382] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.487441] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.488376] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.488376] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.488376] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c189f0d9-5063-4311-a545-fc70d77f7c9d is going to be updated. [ 839.510126] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.510126] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.510126] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.510126] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.510126] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.510126] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c189f0d9-5063-4311-a545-fc70d77f7c9d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.360533] env[69559]: INFO networking_nsxv3.common.synchronization [req-0cfa5513-873f-4e4f-bff1-a9b5a92350e7 req-cfb62ffe-c61a-4468-b8bf-3f7b5651991f tempest-ServersAdminTestJSON-1923717545 tempest-ServersAdminTestJSON-1923717545-project-member] Enqueued Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 840.361442] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 840.361442] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.361871] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.361871] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.361871] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.362126] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.362191] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.362248] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.362542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.362542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.362622] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.562928] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: SUCCESS [ 840.562928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.563091] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.563231] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.563422] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.563542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.563612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.563766] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.563846] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.563941] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.865955] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.066444] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.245678] env[69559]: INFO networking_nsxv3.common.synchronization [req-e6268e1d-040d-40d5-9247-415a93c97f1d req-acc8ba05-b284-4f7d-9798-179c1aef2393 tempest-ServerRescueTestJSON-155966181 tempest-ServerRescueTestJSON-155966181-project-member] Enqueued Resource ID: 734f0202-8a2d-48a6-8b16-336653a0c857 with Priority: HIGHEST for action security_group_members [ 841.246245] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 734f0202-8a2d-48a6-8b16-336653a0c857 with Priority: HIGHEST for action security_group_members [ 841.246741] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-734f0202-8a2d-48a6-8b16-336653a0c857 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.246939] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.246939] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.247151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.248478] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.248478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.248478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.248478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.248478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.248478] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.367970] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.570147] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.720099] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-504 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.720099] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-504" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.720099] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-504" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.721289] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-504" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.721740] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.721924] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.722089] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.722949] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.722949] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.722949] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.722949] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.723206] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.723206] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.723348] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 841.723578] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.723578] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.745027] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.745027] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 841.745027] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.745027] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-504" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.745027] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-10a184ba-4816-4391-988b-eeca14aac179 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.745027] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-10a184ba-4816-4391-988b-eeca14aac179" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.745027] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-10a184ba-4816-4391-988b-eeca14aac179" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.745027] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-10a184ba-4816-4391-988b-eeca14aac179" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.745027] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10a184ba-4816-4391-988b-eeca14aac179',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.750878] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.870117] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.872498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.872498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.872498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.872498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.872498] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fab5e96-3f01-4c71-994f-69059ca62986 is going to be updated. [ 841.900888] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.900888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.900888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.900888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.900888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.910602] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: IN_PROGRESS for 2s [ 842.072982] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.073193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.073265] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.076220] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.076220] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.076220] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e is going to be updated. [ 842.102636] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.102813] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.102886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.103117] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.103264] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.113295] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: IN_PROGRESS for 2s [ 842.247597] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.247902] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.249297] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.249775] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.251026] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.251372] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 10a184ba-4816-4391-988b-eeca14aac179 not found, creating... [ 842.251584] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.251809] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.251970] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.252284] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.253223] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.253583] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.253800] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.253966] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.254240] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.255393] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.255611] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 10a184ba-4816-4391-988b-eeca14aac179 is going to be created. [ 842.256881] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.276614] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.276951] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.277037] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.277256] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.277483] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.277877] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-10a184ba-4816-4391-988b-eeca14aac179" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.761697] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.761697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.761697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.761697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.761697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.761697] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 734f0202-8a2d-48a6-8b16-336653a0c857 is going to be updated. [ 842.802319] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.802466] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.802538] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.803148] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.803304] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.812074] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 734f0202-8a2d-48a6-8b16-336653a0c857 in Status: IN_PROGRESS for 2s [ 843.045579] env[69559]: INFO networking_nsxv3.common.synchronization [None req-6f2d4a69-2510-454b-b5c3-f4a7a8006375 None None] Enqueued Resource ID: e49b8b33-0082-4835-bda5-470214c367b9 with Priority: HIGHEST for action port [ 843.046332] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e49b8b33-0082-4835-bda5-470214c367b9 with Priority: HIGHEST for action port [ 843.046794] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-e49b8b33-0082-4835-bda5-470214c367b9 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.047647] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e49b8b33-0082-4835-bda5-470214c367b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.047647] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e49b8b33-0082-4835-bda5-470214c367b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.047918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e49b8b33-0082-4835-bda5-470214c367b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.048047] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e49b8b33-0082-4835-bda5-470214c367b9',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.175996] env[69559]: INFO networking_nsxv3.common.synchronization [req-e6268e1d-040d-40d5-9247-415a93c97f1d req-337df0f2-1e46-4851-b7e8-5f24ff4931a1 service nova] Enqueued Resource ID: 734f0202-8a2d-48a6-8b16-336653a0c857 with Priority: HIGHEST for action security_group_rules [ 843.176208] env[69559]: INFO networking_nsxv3.common.synchronization [req-e6268e1d-040d-40d5-9247-415a93c97f1d req-337df0f2-1e46-4851-b7e8-5f24ff4931a1 service nova] Enqueued Resource ID: 734f0202-8a2d-48a6-8b16-336653a0c857 with Priority: HIGHEST for action security_group_members [ 843.176352] env[69559]: INFO networking_nsxv3.common.synchronization [req-e6268e1d-040d-40d5-9247-415a93c97f1d req-337df0f2-1e46-4851-b7e8-5f24ff4931a1 service nova] Enqueued Resource ID: 10a184ba-4816-4391-988b-eeca14aac179 with Priority: HIGHEST for action port [ 843.176686] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 734f0202-8a2d-48a6-8b16-336653a0c857 with Priority: HIGHEST for action security_group_rules [ 843.176829] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 734f0202-8a2d-48a6-8b16-336653a0c857 with Priority: HIGHEST for action security_group_members [ 843.176927] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10a184ba-4816-4391-988b-eeca14aac179 with Priority: HIGHEST for action port [ 843.177980] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-734f0202-8a2d-48a6-8b16-336653a0c857 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.178140] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.178201] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.178406] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.178488] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.180436] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-734f0202-8a2d-48a6-8b16-336653a0c857 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.180436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.180436] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-10a184ba-4816-4391-988b-eeca14aac179 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.180436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10a184ba-4816-4391-988b-eeca14aac179" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.180436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10a184ba-4816-4391-988b-eeca14aac179" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.180730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10a184ba-4816-4391-988b-eeca14aac179" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.180730] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10a184ba-4816-4391-988b-eeca14aac179',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.552436] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e49b8b33-0082-4835-bda5-470214c367b9 [ 843.552723] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.552876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.552934] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.553193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.553294] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.553409] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e49b8b33-0082-4835-bda5-470214c367b9 already deleted. [ 843.553496] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e49b8b33-0082-4835-bda5-470214c367b9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.682337] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-734f0202-8a2d-48a6-8b16-336653a0c857 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.682337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.683100] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10a184ba-4816-4391-988b-eeca14aac179 with status ACTIVE [ 843.683399] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.683597] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.683700] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.683981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.684141] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.684419] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.684520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.684606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.684843] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.685125] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.685239] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.685383] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.685491] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.685847] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.685847] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.685963] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10a184ba-4816-4391-988b-eeca14aac179 is going to be updated. [ 843.711715] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.711894] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.711939] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.712607] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.712607] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.712607] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10a184ba-4816-4391-988b-eeca14aac179" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.922137] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: SUCCESS [ 843.922959] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.068612] env[69559]: INFO networking_nsxv3.common.synchronization [req-3724ce40-e0fc-4a35-8d55-01a416602a99 req-d0321104-4d31-4d7a-b656-aa05f55aef4b tempest-ServerRescueNegativeTestJSON-1113411482 tempest-ServerRescueNegativeTestJSON-1113411482-project-member] Enqueued Resource ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b with Priority: HIGHEST for action security_group_members [ 844.072123] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b with Priority: HIGHEST for action security_group_members [ 844.072123] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.072123] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.072123] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.072123] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.072123] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.072123] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.072123] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.072123] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.072123] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.072123] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a11f9ece-2d6a-48aa-bfa9-8e391de87f3b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.127888] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: IN_PROGRESS for 4s [ 844.455397] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-284 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.455397] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-284" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.455397] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-284" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.455397] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-284" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.455397] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.455397] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.455397] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.455397] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.456024] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.456024] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 844.456024] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.456024] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.456313] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.456313] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 844.456313] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.456485] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.473684] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.473876] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 844.474047] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.474731] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-284" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.474731] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-39b97df3-1322-4e10-b561-61dd350d2b35 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.474894] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-39b97df3-1322-4e10-b561-61dd350d2b35" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.474894] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-39b97df3-1322-4e10-b561-61dd350d2b35" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.475247] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-39b97df3-1322-4e10-b561-61dd350d2b35" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.476327] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39b97df3-1322-4e10-b561-61dd350d2b35',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.577883] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.577883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.577883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.577883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.577883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.577883] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.577883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.577883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.577883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.577883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.577883] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b already deleted. [ 844.577883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.821877] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 734f0202-8a2d-48a6-8b16-336653a0c857 in Status: SUCCESS [ 844.821877] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.821877] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.822211] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.822502] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.822859] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.823047] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.823342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.823522] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.823711] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.981790] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.982553] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.982553] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.982553] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.982721] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.982799] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 39b97df3-1322-4e10-b561-61dd350d2b35 not found, creating... [ 844.983088] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.987020] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.987020] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.987020] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.987020] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.987020] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.987020] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.987020] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.987020] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.987020] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.987020] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 39b97df3-1322-4e10-b561-61dd350d2b35 is going to be created. [ 845.006196] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.006196] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.006365] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.006809] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.007100] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.007602] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-39b97df3-1322-4e10-b561-61dd350d2b35" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.198244] env[69559]: INFO networking_nsxv3.common.synchronization [req-3f830df1-6cae-4b1c-bd84-841e7b403396 req-098cae3d-76a6-4489-bcba-82d68ecd3d95 tempest-VolumesAssistedSnapshotsTest-466925179 tempest-VolumesAssistedSnapshotsTest-466925179-project-member] Enqueued Resource ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe with Priority: HIGHEST for action security_group_members [ 845.198392] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe with Priority: HIGHEST for action security_group_members [ 845.198817] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-39b15e36-c638-4ca0-a065-67c76e8f79fe taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.198944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.199034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.199258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.199410] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.199516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.199652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.199750] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.199857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.199917] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39b15e36-c638-4ca0-a065-67c76e8f79fe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.246741] env[69559]: INFO networking_nsxv3.common.synchronization [None req-258909eb-e69b-43bc-aa18-a0acf6ac7ea3 None None] Enqueued Resource ID: 632fae42-1174-4e72-b2ab-aece120f0d3e with Priority: HIGHEST for action port [ 845.247226] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 632fae42-1174-4e72-b2ab-aece120f0d3e with Priority: HIGHEST for action port [ 845.247775] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-632fae42-1174-4e72-b2ab-aece120f0d3e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.247896] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-632fae42-1174-4e72-b2ab-aece120f0d3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.247953] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-632fae42-1174-4e72-b2ab-aece120f0d3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.250502] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-632fae42-1174-4e72-b2ab-aece120f0d3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.250502] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('632fae42-1174-4e72-b2ab-aece120f0d3e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.328504] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.703493] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.703493] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.703493] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.703493] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.703493] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.703736] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.703736] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.703736] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.703927] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.704038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.704139] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe is going to be updated. [ 845.730590] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.730742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.730812] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.731067] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.731301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.739205] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe in Status: IN_PROGRESS for 2s [ 845.761818] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 632fae42-1174-4e72-b2ab-aece120f0d3e [ 845.762200] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.762340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.762422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.762741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.762838] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.763620] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:632fae42-1174-4e72-b2ab-aece120f0d3e already deleted. [ 845.763620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-632fae42-1174-4e72-b2ab-aece120f0d3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.830404] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.975878] env[69559]: INFO networking_nsxv3.common.synchronization [req-3724ce40-e0fc-4a35-8d55-01a416602a99 req-5c3ee91a-2669-4833-80a8-263d28fa6c77 service nova] Enqueued Resource ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b with Priority: HIGHEST for action security_group_rules [ 845.976084] env[69559]: INFO networking_nsxv3.common.synchronization [req-3724ce40-e0fc-4a35-8d55-01a416602a99 req-5c3ee91a-2669-4833-80a8-263d28fa6c77 service nova] Enqueued Resource ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b with Priority: HIGHEST for action security_group_members [ 845.976228] env[69559]: INFO networking_nsxv3.common.synchronization [req-3724ce40-e0fc-4a35-8d55-01a416602a99 req-5c3ee91a-2669-4833-80a8-263d28fa6c77 service nova] Enqueued Resource ID: 39b97df3-1322-4e10-b561-61dd350d2b35 with Priority: HIGHEST for action port [ 845.976520] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b with Priority: HIGHEST for action security_group_rules [ 845.976737] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b with Priority: HIGHEST for action security_group_members [ 845.976842] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b97df3-1322-4e10-b561-61dd350d2b35 with Priority: HIGHEST for action port [ 845.977582] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.977712] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.977780] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.978102] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.978184] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a11f9ece-2d6a-48aa-bfa9-8e391de87f3b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.979118] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.979227] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.979293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.979459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.979624] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.979743] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.979808] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.979942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.980039] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.980131] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a11f9ece-2d6a-48aa-bfa9-8e391de87f3b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.981228] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-39b97df3-1322-4e10-b561-61dd350d2b35 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.981358] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39b97df3-1322-4e10-b561-61dd350d2b35" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.981410] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39b97df3-1322-4e10-b561-61dd350d2b35" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.982760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39b97df3-1322-4e10-b561-61dd350d2b35" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.982760] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39b97df3-1322-4e10-b561-61dd350d2b35',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.138806] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: SUCCESS [ 846.139092] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.139679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.139898] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.140132] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.140256] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.140330] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.140506] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.140565] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.140666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.141526] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.144100] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.144218] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.144519] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.144711] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.144797] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.144950] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.145173] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.145312] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.337434] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.337566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.337639] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.337821] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.337927] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.338036] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 734f0202-8a2d-48a6-8b16-336653a0c857 is going to be updated. [ 846.369029] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.369193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.369253] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.369468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.369643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.378272] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 734f0202-8a2d-48a6-8b16-336653a0c857 in Status: IN_PROGRESS for 2s [ 846.483070] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a11f9ece-2d6a-48aa-bfa9-8e391de87f3b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.484147] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.484284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.484646] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39b97df3-1322-4e10-b561-61dd350d2b35 with status ACTIVE [ 846.484836] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.484963] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.485040] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.485246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.485336] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.485519] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.485582] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.485667] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.485820] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.485901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.486182] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.486182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.486332] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.486400] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.486450] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.486504] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39b97df3-1322-4e10-b561-61dd350d2b35 is going to be updated. [ 846.506863] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.506863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.506863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.506863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.506863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.506863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39b97df3-1322-4e10-b561-61dd350d2b35" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.647808] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.647947] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.648196] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.934459] env[69559]: INFO networking_nsxv3.common.synchronization [req-19610dee-60d4-45d8-8e88-1f8e7aeb9658 req-68551522-52d7-4c8c-8c54-5f829f43cd24 tempest-ServerRescueNegativeTestJSON-1113411482 tempest-ServerRescueNegativeTestJSON-1113411482-project-member] Enqueued Resource ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b with Priority: HIGHEST for action security_group_members [ 846.934748] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b with Priority: HIGHEST for action security_group_members [ 846.935071] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.935197] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.985921] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a11f9ece-2d6a-48aa-bfa9-8e391de87f3b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.154851] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.215296] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-284 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.215497] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-284" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.215626] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-284" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.215900] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-284" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.216179] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.216337] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.216455] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.216803] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.216994] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.217430] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 847.217572] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 847.217692] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 847.217810] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 847.217928] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 847.218050] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 847.218214] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 847.238487] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 847.238728] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 847.238884] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 847.239077] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-284" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.239881] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-27f1bf50-977b-4001-9370-e5e501a44961 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.239881] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-27f1bf50-977b-4001-9370-e5e501a44961" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.239881] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-27f1bf50-977b-4001-9370-e5e501a44961" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.240309] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-27f1bf50-977b-4001-9370-e5e501a44961" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.240425] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27f1bf50-977b-4001-9370-e5e501a44961',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.489047] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.489274] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.489357] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.489582] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.489714] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.489829] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b is going to be created. [ 847.511792] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.511973] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.512041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.512265] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.512429] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.522020] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b in Status: UNINITIALIZED for 2s [ 847.656913] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.657104] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.657154] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.657375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.657465] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.657567] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e is going to be updated. [ 847.709147] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.709147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.709454] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.709507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.709746] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.718666] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: IN_PROGRESS for 2s [ 847.743178] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.743537] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.743728] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.744127] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.744412] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.744640] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 27f1bf50-977b-4001-9370-e5e501a44961 not found, creating... [ 847.745071] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.745378] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.745566] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.745899] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.746162] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.746501] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.746743] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.746892] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.747198] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.747388] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.747563] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 27f1bf50-977b-4001-9370-e5e501a44961 is going to be created. [ 847.749480] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe in Status: SUCCESS [ 847.749652] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe deletion is rescheduled due to dependency. [ 847.749756] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.767716] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.767891] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.768103] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.768451] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.768813] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.769084] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-27f1bf50-977b-4001-9370-e5e501a44961" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.388794] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 734f0202-8a2d-48a6-8b16-336653a0c857 in Status: SUCCESS [ 848.389134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.389258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.389522] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.389770] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.389910] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.390038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.390239] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.390312] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.390390] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.390501] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.524885] env[69559]: INFO networking_nsxv3.common.synchronization [req-19610dee-60d4-45d8-8e88-1f8e7aeb9658 req-4c39d6aa-9772-4b69-a83b-95c593be8f90 service nova] Enqueued Resource ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b with Priority: HIGHEST for action security_group_rules [ 848.525091] env[69559]: INFO networking_nsxv3.common.synchronization [req-19610dee-60d4-45d8-8e88-1f8e7aeb9658 req-4c39d6aa-9772-4b69-a83b-95c593be8f90 service nova] Enqueued Resource ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b with Priority: HIGHEST for action security_group_members [ 848.525238] env[69559]: INFO networking_nsxv3.common.synchronization [req-19610dee-60d4-45d8-8e88-1f8e7aeb9658 req-4c39d6aa-9772-4b69-a83b-95c593be8f90 service nova] Enqueued Resource ID: 27f1bf50-977b-4001-9370-e5e501a44961 with Priority: HIGHEST for action port [ 848.525743] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b with Priority: HIGHEST for action security_group_rules [ 848.525877] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b with Priority: HIGHEST for action security_group_members [ 848.525976] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27f1bf50-977b-4001-9370-e5e501a44961 with Priority: HIGHEST for action port [ 848.526677] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.526677] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.526872] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.526872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.527118] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-27f1bf50-977b-4001-9370-e5e501a44961 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.527252] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27f1bf50-977b-4001-9370-e5e501a44961" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.527344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27f1bf50-977b-4001-9370-e5e501a44961" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.527565] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27f1bf50-977b-4001-9370-e5e501a44961" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.527667] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27f1bf50-977b-4001-9370-e5e501a44961',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.897452] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-734f0202-8a2d-48a6-8b16-336653a0c857 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.897452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.897452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.897452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.897452] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.897452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.897452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.897452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.897452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.897452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.897452] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-734f0202-8a2d-48a6-8b16-336653a0c857 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.897452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.897452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.897452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.897452] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.897452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.898750] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.898750] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.898750] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.898750] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.898750] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.033588] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27f1bf50-977b-4001-9370-e5e501a44961 with status ACTIVE [ 849.033588] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.033588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.033588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.033588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.033588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.033588] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.033588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.033588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.033588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.033588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.033588] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.033588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.033588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.033588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.033588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.033588] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27f1bf50-977b-4001-9370-e5e501a44961 is going to be updated. [ 849.052275] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.052275] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.052275] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.052275] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.052275] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.052275] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27f1bf50-977b-4001-9370-e5e501a44961" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.401541] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 734f0202-8a2d-48a6-8b16-336653a0c857: rpc.has_security_group_logging(os_id): False [ 849.419016] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.419203] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.419272] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.419566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.419635] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.419818] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.419923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.420025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.420186] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.420264] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.420450] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.420545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.420599] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.420740] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.420814] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.425759] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.425759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.425759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.425759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.425759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.425759] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 734f0202-8a2d-48a6-8b16-336653a0c857 is going to be updated. [ 849.482279] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.482414] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.482623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.482877] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.483025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.496292] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 734f0202-8a2d-48a6-8b16-336653a0c857 in Status: IN_PROGRESS for 2s [ 849.532977] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b in Status: SUCCESS [ 849.533107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.533275] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.533552] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.533895] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.534031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.534031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.534211] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.534294] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.534418] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.534517] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a11f9ece-2d6a-48aa-bfa9-8e391de87f3b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.535757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.535959] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.536093] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.536201] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.536265] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.536431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.536605] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.536605] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a11f9ece-2d6a-48aa-bfa9-8e391de87f3b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.728618] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: SUCCESS [ 849.729087] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.729250] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.729676] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.729986] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.730280] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.730354] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.730650] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.730739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.730855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.731098] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.731266] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.731358] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.731563] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.731791] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.731948] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.732070] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.732276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.732413] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.733167] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.733292] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.038765] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.038901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.039119] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a11f9ece-2d6a-48aa-bfa9-8e391de87f3b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.236847] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbe866c5-e7b8-4862-b37c-6b17f875f07e: rpc.has_security_group_logging(os_id): False [ 850.254641] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.254812] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.254926] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.255110] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.255200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.255432] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.255586] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.255586] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.255704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.255758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.255940] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.256042] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.256091] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.256227] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.256294] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.256545] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.256623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.256658] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.256790] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.256864] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.256947] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e is going to be updated. [ 850.315272] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.315496] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.315496] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.315755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.315897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.327657] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: IN_PROGRESS for 2s [ 850.542882] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a11f9ece-2d6a-48aa-bfa9-8e391de87f3b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.046946] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.046946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.046946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.049687] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.049687] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.049687] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b is going to be updated. [ 851.076748] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.076928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.077050] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.077512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.077783] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.086658] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b in Status: IN_PROGRESS for 2s [ 851.510185] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 734f0202-8a2d-48a6-8b16-336653a0c857 in Status: SUCCESS [ 851.510411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.116828] env[69559]: INFO networking_nsxv3.common.synchronization [req-c168f167-e371-4964-b9c5-479c180f2f14 req-6f66620e-88ef-46e7-aa5f-d85225ab5beb tempest-ServerActionsTestOtherB-703157979 tempest-ServerActionsTestOtherB-703157979-project-member] Enqueued Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_members [ 852.118957] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_members [ 852.121794] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-64914acb-965b-4269-aaa5-676103c45a62 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.121925] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.122012] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.122301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.122596] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.122596] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.122741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.122817] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.122873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.122967] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.340750] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: SUCCESS [ 852.341013] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.341222] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.341451] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.341541] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.383474] env[69559]: INFO networking_nsxv3.common.synchronization [req-ef2ccb90-8cc0-473c-93ad-3d5618a416f2 req-47ada7af-cfb7-4cc7-8798-269294e12a0a tempest-ServersTestMultiNic-1711850925 tempest-ServersTestMultiNic-1711850925-project-member] Enqueued Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 852.384207] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 852.384589] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.384972] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.384972] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.384972] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.385132] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.385229] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.385666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.385666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.385666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.385820] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.625496] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.625689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.625760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.625990] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.626086] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.626306] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.626407] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.626486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.626616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.626718] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.626827] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64914acb-965b-4269-aaa5-676103c45a62 already deleted. [ 852.626913] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.834183] env[69559]: INFO networking_nsxv3.common.synchronization [req-ef2ccb90-8cc0-473c-93ad-3d5618a416f2 req-2f8fb78c-5340-48cb-8b41-2b443b197f03 tempest-ServersTestMultiNic-1711850925 tempest-ServersTestMultiNic-1711850925-project-member] Enqueued Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 852.834817] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGHEST for action security_group_members [ 852.835209] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.835318] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.844730] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.844915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.864150] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-289 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.864293] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-289" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.864440] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-289" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.864893] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-289" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.865242] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.865511] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.865676] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.865931] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.866198] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.866452] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 852.866587] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 852.866769] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 852.866954] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 852.867103] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 852.867218] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 852.867391] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 852.887917] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 852.888131] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 852.888282] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 852.888474] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-289" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.888872] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-8166ea41-376c-4083-a48e-74c8f06d0959 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.889070] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-8166ea41-376c-4083-a48e-74c8f06d0959" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.889223] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-8166ea41-376c-4083-a48e-74c8f06d0959" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.889571] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-8166ea41-376c-4083-a48e-74c8f06d0959" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.889727] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8166ea41-376c-4083-a48e-74c8f06d0959',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.890578] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.098942] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b in Status: SUCCESS [ 853.099189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.099353] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.099580] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.099796] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.099924] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.099982] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.101273] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.101390] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.101473] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a11f9ece-2d6a-48aa-bfa9-8e391de87f3b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.392405] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.392805] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.392805] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.393043] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.393201] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.393356] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 8166ea41-376c-4083-a48e-74c8f06d0959 not found, creating... [ 853.393621] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.393781] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.393903] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.394139] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.394282] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.394567] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.394725] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.394847] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.395064] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.395215] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.395357] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 8166ea41-376c-4083-a48e-74c8f06d0959 is going to be created. [ 853.397073] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.414836] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.415151] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.415295] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.415567] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.415999] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.416194] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-8166ea41-376c-4083-a48e-74c8f06d0959" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.607492] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a11f9ece-2d6a-48aa-bfa9-8e391de87f3b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.899317] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.899317] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.899317] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.899682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.899682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.899682] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e is going to be updated. [ 853.925014] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.925173] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.925236] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.925448] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.925732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.935118] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: IN_PROGRESS for 2s [ 854.109888] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a11f9ece-2d6a-48aa-bfa9-8e391de87f3b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.279774] env[69559]: INFO networking_nsxv3.common.synchronization [req-c168f167-e371-4964-b9c5-479c180f2f14 req-00dd5996-61f1-4075-a706-722098aa1a4f service nova] Enqueued Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_rules [ 854.279950] env[69559]: INFO networking_nsxv3.common.synchronization [req-c168f167-e371-4964-b9c5-479c180f2f14 req-00dd5996-61f1-4075-a706-722098aa1a4f service nova] Enqueued Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_members [ 854.280132] env[69559]: INFO networking_nsxv3.common.synchronization [req-c168f167-e371-4964-b9c5-479c180f2f14 req-00dd5996-61f1-4075-a706-722098aa1a4f service nova] Enqueued Resource ID: 8166ea41-376c-4083-a48e-74c8f06d0959 with Priority: HIGHEST for action port [ 854.280970] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_rules [ 854.281236] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_members [ 854.281397] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8166ea41-376c-4083-a48e-74c8f06d0959 with Priority: HIGHEST for action port [ 854.281695] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64914acb-965b-4269-aaa5-676103c45a62 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.281818] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.282023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.282193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.282296] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.283251] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-64914acb-965b-4269-aaa5-676103c45a62 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.283355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.283404] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.283580] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.283961] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.284099] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.284305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.284372] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.284418] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.284515] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.290777] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-8166ea41-376c-4083-a48e-74c8f06d0959 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.290777] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8166ea41-376c-4083-a48e-74c8f06d0959" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.290777] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8166ea41-376c-4083-a48e-74c8f06d0959" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.290777] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8166ea41-376c-4083-a48e-74c8f06d0959" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.290777] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8166ea41-376c-4083-a48e-74c8f06d0959',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.365118] env[69559]: INFO networking_nsxv3.common.synchronization [req-03013eb8-3494-400a-8fe2-de244d3b91ba req-6e704b40-a46b-45c6-95c5-cc04791dcbc3 tempest-ServersNegativeTestJSON-583757154 tempest-ServersNegativeTestJSON-583757154-project-member] Enqueued Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGHEST for action security_group_members [ 854.365118] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGHEST for action security_group_members [ 854.365118] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.365118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.365118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.365867] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.366157] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.366381] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.366771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.367076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.367266] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.367578] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.612892] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.613385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.613385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.613385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.613669] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.613669] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b is going to be updated. [ 854.640630] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.640737] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.640776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.640988] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.641136] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.654439] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b in Status: IN_PROGRESS for 2s [ 854.693443] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-286 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.693809] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-286" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.694404] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-286" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.694404] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-286" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.694684] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.694851] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.694970] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.695211] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.695627] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.695880] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 854.696190] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 854.696190] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 854.696307] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 854.696402] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 854.696508] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 854.696640] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 854.718295] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 854.718450] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 854.719040] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 854.719040] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-286" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.719246] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-8b195509-2c2b-4af5-b2c9-c8ed1de56059 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.719431] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-8b195509-2c2b-4af5-b2c9-c8ed1de56059" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.719555] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-8b195509-2c2b-4af5-b2c9-c8ed1de56059" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.719956] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-8b195509-2c2b-4af5-b2c9-c8ed1de56059" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.720129] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b195509-2c2b-4af5-b2c9-c8ed1de56059',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.790952] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-64914acb-965b-4269-aaa5-676103c45a62 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.791121] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.791340] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.795367] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8166ea41-376c-4083-a48e-74c8f06d0959 with status ACTIVE [ 854.795367] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.795367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.795367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.795367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.795367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.795367] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.795367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.795367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.795367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.795367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.795367] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.795367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.795367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.795367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.795367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.796476] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8166ea41-376c-4083-a48e-74c8f06d0959 is going to be updated. [ 854.826146] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.826146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.826146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.826146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.826146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.826146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8166ea41-376c-4083-a48e-74c8f06d0959" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.869950] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.870158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.870238] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.870537] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.870671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.870954] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.871091] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.871138] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.871316] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.871460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.871561] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 already deleted. [ 854.871660] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.222980] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.223391] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.223473] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.223778] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.223984] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.224200] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 8b195509-2c2b-4af5-b2c9-c8ed1de56059 not found, creating... [ 855.224511] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.224719] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.224899] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.225169] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.225356] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.225678] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.225935] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.226032] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.226283] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.226433] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.226579] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 8b195509-2c2b-4af5-b2c9-c8ed1de56059 is going to be created. [ 855.250017] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.250017] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.250017] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.250017] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.250017] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.250017] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-8b195509-2c2b-4af5-b2c9-c8ed1de56059" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.298776] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.801174] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.801490] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.801490] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.801696] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.801787] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.801891] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64914acb-965b-4269-aaa5-676103c45a62 is going to be created. [ 855.825370] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.825564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.825623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.825803] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.825961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.835301] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: UNINITIALIZED for 2s [ 855.944420] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: SUCCESS [ 855.944897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.944897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.945181] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.945362] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.945594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.945594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.945758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.945758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.945827] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.044263] env[69559]: INFO networking_nsxv3.common.synchronization [req-03013eb8-3494-400a-8fe2-de244d3b91ba req-9eca90e0-7598-4f00-bd56-2e5b77275353 service nova] Enqueued Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGHEST for action security_group_rules [ 856.044263] env[69559]: INFO networking_nsxv3.common.synchronization [req-03013eb8-3494-400a-8fe2-de244d3b91ba req-9eca90e0-7598-4f00-bd56-2e5b77275353 service nova] Enqueued Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGHEST for action security_group_members [ 856.044263] env[69559]: INFO networking_nsxv3.common.synchronization [req-03013eb8-3494-400a-8fe2-de244d3b91ba req-9eca90e0-7598-4f00-bd56-2e5b77275353 service nova] Enqueued Resource ID: 8b195509-2c2b-4af5-b2c9-c8ed1de56059 with Priority: HIGHEST for action port [ 856.044263] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGHEST for action security_group_rules [ 856.044263] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGHEST for action security_group_members [ 856.044263] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b195509-2c2b-4af5-b2c9-c8ed1de56059 with Priority: HIGHEST for action port [ 856.044263] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbcf9733-e0a4-4cd5-bcff-a59904ddee14 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.044263] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.044263] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.044263] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.044627] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.045290] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.045416] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.045416] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.045573] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.045717] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.045810] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.045890] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.046016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.046108] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.046197] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.046975] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b195509-2c2b-4af5-b2c9-c8ed1de56059 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.047111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b195509-2c2b-4af5-b2c9-c8ed1de56059" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.047154] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b195509-2c2b-4af5-b2c9-c8ed1de56059" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.047733] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b195509-2c2b-4af5-b2c9-c8ed1de56059" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.047733] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b195509-2c2b-4af5-b2c9-c8ed1de56059',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.436751] env[69559]: INFO networking_nsxv3.common.synchronization [req-6a266e85-6b24-4d5c-8a88-178862cc13a8 req-4b99c368-d4bf-4237-95e4-ba8cf79b0e8c tempest-ImagesTestJSON-1150485476 tempest-ImagesTestJSON-1150485476-project-member] Enqueued Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 856.437486] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 856.437948] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.437948] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.437948] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.438196] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.439179] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.439179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.439179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.439179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.439179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.439179] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.449353] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.449514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.449514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.449658] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.449744] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.449927] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.450029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.450086] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.450222] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.450293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.450370] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e is going to be updated. [ 856.474246] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.474396] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.474467] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.474680] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.474818] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.484598] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: IN_PROGRESS for 2s [ 856.548790] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.549045] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.549140] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.550063] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b195509-2c2b-4af5-b2c9-c8ed1de56059 with status ACTIVE [ 856.550257] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.550368] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.550434] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.550635] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.550724] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.550890] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.550981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.550981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.551204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.551271] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.551446] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.551541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.551603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.551738] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.551810] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.551892] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b195509-2c2b-4af5-b2c9-c8ed1de56059 is going to be updated. [ 856.572125] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.572288] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.572411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.572540] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.572681] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.572840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b195509-2c2b-4af5-b2c9-c8ed1de56059" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.670952] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b in Status: SUCCESS [ 856.671194] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.671352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.671583] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.671768] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.671880] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.671956] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.672121] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.672204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.674136] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.674136] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.674136] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.674136] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.674136] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.674136] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.674136] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.674136] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.674136] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.674136] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.674136] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.674136] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a11f9ece-2d6a-48aa-bfa9-8e391de87f3b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.941012] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.941332] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.941332] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.941458] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.941549] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.941787] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.941903] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.941991] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.942197] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.942284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.942376] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 is going to be updated. [ 856.975189] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.975420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.975420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.975677] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.975832] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.984416] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: IN_PROGRESS for 2s [ 857.054405] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.175436] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a11f9ece-2d6a-48aa-bfa9-8e391de87f3b: rpc.has_security_group_logging(os_id): False [ 857.194431] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.194431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.194431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.194431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.194431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.194431] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.194431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.194431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.194431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.194431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.195192] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.195192] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.195192] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.195192] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.195192] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.195192] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.195192] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.195192] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.195519] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.195519] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.195519] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b is going to be created. [ 857.283687] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.283687] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.283687] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.283687] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.283687] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.303690] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b in Status: IN_PROGRESS for 2s [ 857.409607] env[69559]: INFO networking_nsxv3.common.synchronization [req-275dd24c-09ae-4925-a8e1-d0808bef3757 req-93669bbc-88d7-4f5d-82a0-253bcb389ce7 tempest-DeleteServersTestJSON-1423597435 tempest-DeleteServersTestJSON-1423597435-project-member] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 857.410899] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 857.411406] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.411607] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.411722] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.412373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.412634] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.412794] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.412906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.413168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.413314] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.413586] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.556803] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.556968] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.557057] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.557265] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.557352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.557589] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 is going to be created. [ 857.582186] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.582348] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.582399] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.582616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.582793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.591067] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 in Status: UNINITIALIZED for 2s [ 857.844955] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: SUCCESS [ 857.845292] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.845540] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.845845] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.846156] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.846340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.846453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.846794] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.846931] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.847087] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.847234] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.917556] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.917556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.917556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.917797] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.917853] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.918125] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.918221] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.918221] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.918377] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.918428] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.918536] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be updated. [ 857.948570] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.948570] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.948570] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.948570] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.948570] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.962993] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 858.352093] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.494032] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: SUCCESS [ 858.494032] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e deletion is rescheduled due to dependency. [ 858.494032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.494032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.494032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.494032] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.494032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.494032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.494852] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.495059] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.495235] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.495404] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.854211] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64914acb-965b-4269-aaa5-676103c45a62: rpc.has_security_group_logging(os_id): False [ 858.875703] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.876072] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.876072] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.876266] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.876266] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.876522] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.876648] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.876818] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.876893] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.876961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.877053] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64914acb-965b-4269-aaa5-676103c45a62 is going to be created. [ 858.997694] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.998074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.998074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.998177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.998361] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.998464] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.998519] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.998698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.998812] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.998932] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.999102] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.999197] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.999257] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.999405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.999543] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.999636] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.999706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.999884] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.999961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.000051] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.000143] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.004606] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: SUCCESS [ 859.004606] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 deletion is rescheduled due to dependency. [ 859.004606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.029545] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.029795] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.029851] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.030062] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.030285] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.040849] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: IN_PROGRESS for 2s [ 859.316385] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b in Status: SUCCESS [ 859.316385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.316563] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.317601] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.317601] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a11f9ece-2d6a-48aa-bfa9-8e391de87f3b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.503055] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbe866c5-e7b8-4862-b37c-6b17f875f07e: rpc.has_security_group_logging(os_id): False [ 859.522327] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.522475] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.522547] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.522756] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.522847] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.523218] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.523366] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.523431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.523586] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.523664] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.523859] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.523955] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.524035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.524181] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.524254] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.524448] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.524541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.524624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.524735] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.524809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.524892] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e is going to be updated. [ 859.580009] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.580193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.580263] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.580468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.580611] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.595557] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: IN_PROGRESS for 2s [ 859.598324] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 in Status: SUCCESS [ 859.598518] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.598663] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.598933] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.599141] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.599258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.599323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.599475] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.599554] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.599640] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.599773] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.819411] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.819525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.819594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.819969] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.820355] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.820463] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.820527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.821526] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.821526] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.821526] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.821526] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a11f9ece-2d6a-48aa-bfa9-8e391de87f3b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.970814] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 859.970996] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d deletion is rescheduled due to dependency. [ 859.971133] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.022979] env[69559]: INFO networking_nsxv3.common.synchronization [req-5f3315f6-9ca8-484e-83ae-a102822152eb req-9c7b6649-39e1-4807-a5ca-db1dd3bb9b14 tempest-ServerPasswordTestJSON-575237089 tempest-ServerPasswordTestJSON-575237089-project-member] Enqueued Resource ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 with Priority: HIGHEST for action security_group_members [ 860.023982] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 with Priority: HIGHEST for action security_group_members [ 860.024396] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.024566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.024651] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.024976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.025205] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.025335] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.025416] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.025619] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.025768] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.025904] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2e65fdd-c8b6-417a-a531-e6273e09a7c2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.102219] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.102370] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.102434] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.102646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.102803] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.102904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.102966] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.103129] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.103216] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.103420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.103501] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.103568] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.103606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.103722] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.103856] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.103944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.104023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.104154] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.104236] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.104309] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.104395] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.324534] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.324689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.324763] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.324984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.325178] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.325318] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.325372] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.325516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.325605] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.325692] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.325845] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.325939] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.326058] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.330313] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.330509] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.330619] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.330689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.330838] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.330928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.331068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.331174] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a11f9ece-2d6a-48aa-bfa9-8e391de87f3b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.335853] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.336063] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-458" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.336198] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-458" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.336502] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-458" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.336855] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.337048] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.337178] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.337398] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.337550] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.337758] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 860.337877] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 860.337992] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 860.338119] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 860.338234] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 860.338344] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 860.338480] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 860.340578] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a11f9ece-2d6a-48aa-bfa9-8e391de87f3b: rpc.has_security_group_logging(os_id): False [ 860.357956] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.358113] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.358149] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.358339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.358432] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.358629] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.358771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.358877] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.359016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.359090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.359296] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.359389] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.359449] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.359586] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.359722] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.359873] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.359974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.360830] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.361041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.361259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.361259] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b is going to be updated. [ 860.365476] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 860.365678] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 860.365839] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 860.370078] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-458" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.370459] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-d7f5da84-f8fa-46ee-a987-aa06b83a2080 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.370656] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-d7f5da84-f8fa-46ee-a987-aa06b83a2080" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.370786] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-d7f5da84-f8fa-46ee-a987-aa06b83a2080" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.371083] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-d7f5da84-f8fa-46ee-a987-aa06b83a2080" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.371227] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7f5da84-f8fa-46ee-a987-aa06b83a2080',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.426396] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.426523] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.426570] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.426870] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.427025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.442238] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b in Status: IN_PROGRESS for 2s [ 860.528979] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.529178] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.529263] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.529488] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.529624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.529806] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.529921] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.529982] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.530156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.530253] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.530344] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 already deleted. [ 860.530464] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.606920] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbcf9733-e0a4-4cd5-bcff-a59904ddee14: rpc.has_security_group_logging(os_id): False [ 860.626142] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.626346] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.626397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.626607] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.626710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.626912] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.627031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.627095] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.627267] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.627344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.627558] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.627668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.627758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.627982] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.628084] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.628304] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.628423] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.628485] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.629033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.629033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.629033] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 is going to be created. [ 860.687219] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.687425] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.687425] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.687619] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.687927] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.698509] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 in Status: IN_PROGRESS for 2s [ 860.874465] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.874791] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.874931] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.875248] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.875405] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.875565] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port d7f5da84-f8fa-46ee-a987-aa06b83a2080 not found, creating... [ 860.877136] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.877136] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.877136] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.877136] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.877136] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.877136] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.877545] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.877545] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.877545] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.877641] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.877930] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: d7f5da84-f8fa-46ee-a987-aa06b83a2080 is going to be created. [ 860.901052] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.901398] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.901474] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.901758] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.902011] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.902253] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-d7f5da84-f8fa-46ee-a987-aa06b83a2080" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.063922] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: SUCCESS [ 861.063922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.610113] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e in Status: SUCCESS [ 861.610438] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.618900] env[69559]: INFO networking_nsxv3.common.synchronization [req-5f3315f6-9ca8-484e-83ae-a102822152eb req-49c2276b-23d2-49bc-a320-7c1099a596db service nova] Enqueued Resource ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 with Priority: HIGHEST for action security_group_rules [ 861.619118] env[69559]: INFO networking_nsxv3.common.synchronization [req-5f3315f6-9ca8-484e-83ae-a102822152eb req-49c2276b-23d2-49bc-a320-7c1099a596db service nova] Enqueued Resource ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 with Priority: HIGHEST for action security_group_members [ 861.619265] env[69559]: INFO networking_nsxv3.common.synchronization [req-5f3315f6-9ca8-484e-83ae-a102822152eb req-49c2276b-23d2-49bc-a320-7c1099a596db service nova] Enqueued Resource ID: d7f5da84-f8fa-46ee-a987-aa06b83a2080 with Priority: HIGHEST for action port [ 861.619508] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 with Priority: HIGHEST for action security_group_rules [ 861.619647] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 with Priority: HIGHEST for action security_group_members [ 861.619786] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7f5da84-f8fa-46ee-a987-aa06b83a2080 with Priority: HIGHEST for action port [ 861.620296] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2e65fdd-c8b6-417a-a531-e6273e09a7c2 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.620426] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.620492] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.620742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.621355] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2e65fdd-c8b6-417a-a531-e6273e09a7c2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.621840] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.621840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.621840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.622024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.622166] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.622261] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.622339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.622493] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.622589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.622679] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2e65fdd-c8b6-417a-a531-e6273e09a7c2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.623408] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7f5da84-f8fa-46ee-a987-aa06b83a2080 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.623515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7f5da84-f8fa-46ee-a987-aa06b83a2080" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.623824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7f5da84-f8fa-46ee-a987-aa06b83a2080" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.623824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7f5da84-f8fa-46ee-a987-aa06b83a2080" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.623824] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7f5da84-f8fa-46ee-a987-aa06b83a2080',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.125596] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.125888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.125934] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2e65fdd-c8b6-417a-a531-e6273e09a7c2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.128742] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7f5da84-f8fa-46ee-a987-aa06b83a2080 with status ACTIVE [ 862.128742] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.128742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.128742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.128742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.128742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.128742] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.128742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.128742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.128742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.128742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.128742] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.128742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.129298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.129298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.129298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.129298] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7f5da84-f8fa-46ee-a987-aa06b83a2080 is going to be updated. [ 862.151406] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.151580] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.151671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.151858] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.151986] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.152161] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7f5da84-f8fa-46ee-a987-aa06b83a2080" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.455291] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b in Status: SUCCESS [ 862.455631] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.631071] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2e65fdd-c8b6-417a-a531-e6273e09a7c2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.714929] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 in Status: SUCCESS [ 862.714929] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.134145] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.134649] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.134649] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.134649] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.134793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.134793] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 is going to be created. [ 863.161035] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.161319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.161319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.161518] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.161698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.172534] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 in Status: UNINITIALIZED for 2s [ 864.939387] env[69559]: INFO networking_nsxv3.common.synchronization [req-62c51055-577c-4d9d-9ff8-60f6058501eb req-8d965643-90ef-4aea-a28f-267da30d6535 tempest-AttachVolumeNegativeTest-1400300488 tempest-AttachVolumeNegativeTest-1400300488-project-member] Enqueued Resource ID: 362fb317-5783-4d37-bba5-4e590ce7111d with Priority: HIGHEST for action security_group_members [ 864.939986] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 362fb317-5783-4d37-bba5-4e590ce7111d with Priority: HIGHEST for action security_group_members [ 864.940651] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-362fb317-5783-4d37-bba5-4e590ce7111d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.940784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.940857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.941473] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.941644] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.941750] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.941816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.941983] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.942087] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.942185] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('362fb317-5783-4d37-bba5-4e590ce7111d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.188024] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 in Status: SUCCESS [ 865.188024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.188024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.188024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.188024] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.188024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.188024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.188024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.188024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.188024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.188024] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2e65fdd-c8b6-417a-a531-e6273e09a7c2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.444207] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.444381] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.444456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.444646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.444733] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.444932] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.445080] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.445132] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.445254] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.445336] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.445413] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 362fb317-5783-4d37-bba5-4e590ce7111d already deleted. [ 865.445486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.488991] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-979 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.488991] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-979" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.488991] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-979" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.488991] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-979" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.489617] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.489837] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.489970] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.490232] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.490390] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.490930] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.491077] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.491232] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.491385] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.491476] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.491593] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.491732] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 865.510388] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 865.510596] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 865.510788] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 865.511887] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-979" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.511887] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-59b4d1a9-a449-4dfa-b334-5199c92f2a02 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.511887] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-59b4d1a9-a449-4dfa-b334-5199c92f2a02" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.511887] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-59b4d1a9-a449-4dfa-b334-5199c92f2a02" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.512216] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-59b4d1a9-a449-4dfa-b334-5199c92f2a02" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.516292] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59b4d1a9-a449-4dfa-b334-5199c92f2a02',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.696041] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.696041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.696041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.696041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.696041] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.696041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.696041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.696041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.696041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.696041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.696041] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.696041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.696041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.696041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.696041] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.696041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.697358] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.697358] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.697358] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.697358] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.697358] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2e65fdd-c8b6-417a-a531-e6273e09a7c2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.018961] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.018961] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.018961] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.019495] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.019495] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.019495] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 59b4d1a9-a449-4dfa-b334-5199c92f2a02 not found, creating... [ 866.020732] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.020732] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.020732] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.020732] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.020732] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.020732] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.021060] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.021060] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.021264] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.021444] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.021616] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 59b4d1a9-a449-4dfa-b334-5199c92f2a02 is going to be created. [ 866.044277] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.044495] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.044623] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.045062] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.045146] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.045377] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-59b4d1a9-a449-4dfa-b334-5199c92f2a02" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.201914] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2e65fdd-c8b6-417a-a531-e6273e09a7c2: rpc.has_security_group_logging(os_id): False [ 866.227155] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.227444] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.227444] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.227653] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.227773] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.228008] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.228117] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.228198] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.228341] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.228412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.228588] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.228682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.228740] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.228891] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.228966] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.233314] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.233459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.233567] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.234564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.234564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.234564] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 is going to be created. [ 866.290413] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.290698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.290698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.290849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.290981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.302371] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 in Status: IN_PROGRESS for 2s [ 866.998590] env[69559]: INFO networking_nsxv3.common.synchronization [req-62c51055-577c-4d9d-9ff8-60f6058501eb req-dd57c43e-d04d-4919-97a7-3cd1130e7ae7 service nova] Enqueued Resource ID: 362fb317-5783-4d37-bba5-4e590ce7111d with Priority: HIGHEST for action security_group_rules [ 866.998590] env[69559]: INFO networking_nsxv3.common.synchronization [req-62c51055-577c-4d9d-9ff8-60f6058501eb req-dd57c43e-d04d-4919-97a7-3cd1130e7ae7 service nova] Enqueued Resource ID: 362fb317-5783-4d37-bba5-4e590ce7111d with Priority: HIGHEST for action security_group_members [ 866.998590] env[69559]: INFO networking_nsxv3.common.synchronization [req-62c51055-577c-4d9d-9ff8-60f6058501eb req-dd57c43e-d04d-4919-97a7-3cd1130e7ae7 service nova] Enqueued Resource ID: 59b4d1a9-a449-4dfa-b334-5199c92f2a02 with Priority: HIGHEST for action port [ 866.999114] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 362fb317-5783-4d37-bba5-4e590ce7111d with Priority: HIGHEST for action security_group_rules [ 866.999498] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 362fb317-5783-4d37-bba5-4e590ce7111d with Priority: HIGHEST for action security_group_members [ 866.999498] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59b4d1a9-a449-4dfa-b334-5199c92f2a02 with Priority: HIGHEST for action port [ 867.000324] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-362fb317-5783-4d37-bba5-4e590ce7111d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.001525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.001525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.001525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.001525] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('362fb317-5783-4d37-bba5-4e590ce7111d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.003105] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-362fb317-5783-4d37-bba5-4e590ce7111d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.003105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.003240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.003458] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.003618] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.003732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.003794] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.003939] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.004029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.004153] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('362fb317-5783-4d37-bba5-4e590ce7111d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.008603] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-59b4d1a9-a449-4dfa-b334-5199c92f2a02 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.008603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59b4d1a9-a449-4dfa-b334-5199c92f2a02" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.008603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59b4d1a9-a449-4dfa-b334-5199c92f2a02" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.008603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59b4d1a9-a449-4dfa-b334-5199c92f2a02" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.008603] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59b4d1a9-a449-4dfa-b334-5199c92f2a02',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.507794] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-362fb317-5783-4d37-bba5-4e590ce7111d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.507794] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.510132] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('362fb317-5783-4d37-bba5-4e590ce7111d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.511095] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 59b4d1a9-a449-4dfa-b334-5199c92f2a02 with status ACTIVE [ 867.511321] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.511446] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.511512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.512478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.512478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.512478] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.512478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.512478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.512478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.512478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.512722] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.512722] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.512722] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.512812] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.512871] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.512955] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 59b4d1a9-a449-4dfa-b334-5199c92f2a02 is going to be updated. [ 867.536025] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.536025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.536025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.536025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.536025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.536025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59b4d1a9-a449-4dfa-b334-5199c92f2a02" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.688485] env[69559]: INFO networking_nsxv3.common.synchronization [req-ffa1279d-e71f-4b74-b8d1-58d172c728ed req-5b084023-6075-4dc7-ab57-086279487786 tempest-ServersTestFqdnHostnames-1882326979 tempest-ServersTestFqdnHostnames-1882326979-project-member] Enqueued Resource ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 with Priority: HIGHEST for action security_group_members [ 867.689109] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 with Priority: HIGHEST for action security_group_members [ 867.689568] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2d4f121-303e-4c6b-ac7a-e595df5750d8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.690668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.691415] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.691791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.692089] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.692256] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.692351] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.692735] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.692976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.693276] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2d4f121-303e-4c6b-ac7a-e595df5750d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.015535] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('362fb317-5783-4d37-bba5-4e590ce7111d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.195529] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.195781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.195901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.196256] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.227484] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.227870] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.228075] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.228186] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.228478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.228755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.228755] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 is going to be updated. [ 868.277476] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.277657] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.277780] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.278097] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.278314] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.288906] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 in Status: IN_PROGRESS for 2s [ 868.318519] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 in Status: SUCCESS [ 868.318886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.517878] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.518219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.518219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.518395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.518519] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.518648] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 362fb317-5783-4d37-bba5-4e590ce7111d is going to be created. [ 868.539475] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.539475] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.539475] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.539674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.539852] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.547744] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 362fb317-5783-4d37-bba5-4e590ce7111d in Status: UNINITIALIZED for 2s [ 870.302578] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 in Status: SUCCESS [ 870.302838] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 deletion is rescheduled due to dependency. [ 870.304014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.508639] env[69559]: INFO networking_nsxv3.common.synchronization [req-787d94ee-e498-4537-ae41-4c3923c0d1a3 req-2c4534d4-8dd5-43f9-b8c0-79569c18fa58 tempest-AttachInterfacesUnderV243Test-114660582 tempest-AttachInterfacesUnderV243Test-114660582-project-member] Enqueued Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_members [ 870.509256] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_members [ 870.509557] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-1068186a-ec83-4273-b088-3f5610ae229e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.509729] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.509729] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.509936] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.510105] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.510204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.510265] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.510406] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.510492] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.510605] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.537471] env[69559]: INFO networking_nsxv3.common.synchronization [req-787d94ee-e498-4537-ae41-4c3923c0d1a3 req-2c4534d4-8dd5-43f9-b8c0-79569c18fa58 tempest-AttachInterfacesUnderV243Test-114660582 tempest-AttachInterfacesUnderV243Test-114660582-project-member] Enqueued Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_rules [ 870.537661] env[69559]: INFO networking_nsxv3.common.synchronization [req-787d94ee-e498-4537-ae41-4c3923c0d1a3 req-2c4534d4-8dd5-43f9-b8c0-79569c18fa58 tempest-AttachInterfacesUnderV243Test-114660582 tempest-AttachInterfacesUnderV243Test-114660582-project-member] Enqueued Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_members [ 870.537913] env[69559]: INFO networking_nsxv3.common.synchronization [req-787d94ee-e498-4537-ae41-4c3923c0d1a3 req-2c4534d4-8dd5-43f9-b8c0-79569c18fa58 tempest-AttachInterfacesUnderV243Test-114660582 tempest-AttachInterfacesUnderV243Test-114660582-project-member] Enqueued Resource ID: acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7 with Priority: HIGHEST for action port [ 870.538473] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_rules [ 870.538619] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_members [ 870.538722] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7 with Priority: HIGHEST for action port [ 870.539668] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1068186a-ec83-4273-b088-3f5610ae229e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.539862] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.539973] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.540272] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.540324] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.541246] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-1068186a-ec83-4273-b088-3f5610ae229e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.541364] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.541672] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.541771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.541844] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.542076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.542155] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.557752] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 362fb317-5783-4d37-bba5-4e590ce7111d in Status: SUCCESS [ 870.559169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.559169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.559339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.559585] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.559734] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.559762] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.560766] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.560766] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.560766] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.560766] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('362fb317-5783-4d37-bba5-4e590ce7111d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.013440] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.045096] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7 with status ACTIVE [ 871.045322] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.045457] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.045557] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.045850] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.045993] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.046254] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.046363] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.046441] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.046615] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.046849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.046988] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.047109] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.047172] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.047316] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.047391] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.047474] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7 is going to be updated. [ 871.048694] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-1068186a-ec83-4273-b088-3f5610ae229e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.048789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.066741] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('362fb317-5783-4d37-bba5-4e590ce7111d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.067250] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.067250] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.067555] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.067608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.067837] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.068046] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.516056] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.564833] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 362fb317-5783-4d37-bba5-4e590ce7111d: rpc.has_security_group_logging(os_id): False [ 871.583248] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.583248] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.583248] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.583248] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.583248] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.583248] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.583512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.583512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.583624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.583709] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.583822] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 362fb317-5783-4d37-bba5-4e590ce7111d is going to be created. [ 871.636316] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.636496] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.636883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.636883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.637084] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.648816] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 362fb317-5783-4d37-bba5-4e590ce7111d in Status: IN_PROGRESS for 2s [ 872.021023] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.021023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.021023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.021023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.021023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.021023] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1068186a-ec83-4273-b088-3f5610ae229e is going to be updated. [ 872.052680] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.052844] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.052913] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.053151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.053294] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.061829] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1068186a-ec83-4273-b088-3f5610ae229e in Status: IN_PROGRESS for 2s [ 872.359645] env[69559]: INFO networking_nsxv3.common.synchronization [req-018ebae3-1931-47e4-8b5c-47f401f62afd req-a475fc80-2c3a-44d4-8faa-e785e554f8d1 tempest-ServerRescueTestJSON-155966181 tempest-ServerRescueTestJSON-155966181-project-member] Enqueued Resource ID: 734f0202-8a2d-48a6-8b16-336653a0c857 with Priority: HIGHEST for action security_group_members [ 872.360219] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 734f0202-8a2d-48a6-8b16-336653a0c857 with Priority: HIGHEST for action security_group_members [ 872.360527] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-734f0202-8a2d-48a6-8b16-336653a0c857 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.360648] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.360724] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.360974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.361221] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.361336] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.361386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.361548] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.361629] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.361719] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.864811] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.914857] env[69559]: INFO networking_nsxv3.common.synchronization [req-689741be-317a-4888-8220-37db23b1b4c4 req-56f5d440-e1d8-4537-a93a-efdefdc4d3c1 tempest-ServerPasswordTestJSON-575237089 tempest-ServerPasswordTestJSON-575237089-project-member] Enqueued Resource ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 with Priority: HIGHEST for action security_group_members [ 872.915396] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 with Priority: HIGHEST for action security_group_members [ 872.916021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.916021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.916156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.916335] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.916542] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.916689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.916779] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.916982] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.917126] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.917271] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2e65fdd-c8b6-417a-a531-e6273e09a7c2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.366477] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.420546] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.420754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.420754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.421057] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.421166] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.421412] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.421559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.421627] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.421795] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.421899] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.421987] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 is going to be updated. [ 873.450288] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.450503] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.450503] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.450774] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.450948] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.459173] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 in Status: IN_PROGRESS for 2s [ 873.631020] env[69559]: INFO networking_nsxv3.common.synchronization [req-99656b22-10a4-4788-b71f-96d5e99e0650 req-ba0e4365-d55c-4e99-af9a-d8d164e28c25 tempest-AttachInterfacesUnderV243Test-114660582 tempest-AttachInterfacesUnderV243Test-114660582-project-member] Enqueued Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_members [ 873.631020] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_members [ 873.631020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-1068186a-ec83-4273-b088-3f5610ae229e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.631020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.645618] env[69559]: INFO networking_nsxv3.common.synchronization [req-99656b22-10a4-4788-b71f-96d5e99e0650 req-ba0e4365-d55c-4e99-af9a-d8d164e28c25 tempest-AttachInterfacesUnderV243Test-114660582 tempest-AttachInterfacesUnderV243Test-114660582-project-member] Enqueued Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_rules [ 873.645798] env[69559]: INFO networking_nsxv3.common.synchronization [req-99656b22-10a4-4788-b71f-96d5e99e0650 req-ba0e4365-d55c-4e99-af9a-d8d164e28c25 tempest-AttachInterfacesUnderV243Test-114660582 tempest-AttachInterfacesUnderV243Test-114660582-project-member] Enqueued Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_members [ 873.645974] env[69559]: INFO networking_nsxv3.common.synchronization [req-99656b22-10a4-4788-b71f-96d5e99e0650 req-ba0e4365-d55c-4e99-af9a-d8d164e28c25 tempest-AttachInterfacesUnderV243Test-114660582 tempest-AttachInterfacesUnderV243Test-114660582-project-member] Enqueued Resource ID: acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7 with Priority: HIGHEST for action port [ 873.646762] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_rules [ 873.646871] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_members [ 873.646969] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7 with Priority: HIGHEST for action port [ 873.647282] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1068186a-ec83-4273-b088-3f5610ae229e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.647383] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.647582] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-1068186a-ec83-4273-b088-3f5610ae229e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.647666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.647874] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.648772] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.648841] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.649058] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.649175] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.660754] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 362fb317-5783-4d37-bba5-4e590ce7111d in Status: SUCCESS [ 873.660754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.868697] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.869027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.869027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.869238] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.869344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.869448] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 734f0202-8a2d-48a6-8b16-336653a0c857 is going to be updated. [ 873.894688] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.894756] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.894798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.895046] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.895194] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.902923] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 734f0202-8a2d-48a6-8b16-336653a0c857 in Status: IN_PROGRESS for 2s [ 874.070664] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1068186a-ec83-4273-b088-3f5610ae229e in Status: SUCCESS [ 874.070924] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.071056] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.071368] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.071555] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.071670] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.071737] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.071886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.072016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.072139] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.152379] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7 with status ACTIVE [ 874.152610] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.152745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.152814] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.153034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.153214] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.153310] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.153433] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.153495] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.153694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.153786] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.153994] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.154105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.154180] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.154305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.154379] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.154465] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7 is going to be updated. [ 874.174546] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.174749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.174808] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.174990] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.175141] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.175344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acd9e6d4-9c60-47a2-9c58-de9ee19c4ef7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.574428] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.076250] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.468197] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 in Status: SUCCESS [ 875.468378] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 deletion is rescheduled due to dependency. [ 875.468489] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.581453] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.581666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.581666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.581894] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.582116] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.582225] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1068186a-ec83-4273-b088-3f5610ae229e is going to be updated. [ 875.617602] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.617752] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.618038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.618038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.618671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.626630] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1068186a-ec83-4273-b088-3f5610ae229e in Status: IN_PROGRESS for 2s [ 875.912563] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 734f0202-8a2d-48a6-8b16-336653a0c857 in Status: SUCCESS [ 875.912781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.227513] env[69559]: INFO networking_nsxv3.common.synchronization [req-67a77eee-afa4-4ab0-8b84-aac2dd82eab0 req-d46a84cd-c58d-4bcd-b20e-5973149d08c1 tempest-ServersAdminTestJSON-1923717545 tempest-ServersAdminTestJSON-1923717545-project-member] Enqueued Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 876.228086] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 876.229043] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.229043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.229043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.229043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.229043] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.229387] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.229424] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.229583] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.229671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.229770] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.454796] env[69559]: INFO networking_nsxv3.common.synchronization [req-d5d6a6b5-2ba7-4829-822d-b752867823d7 req-361a3028-f2b9-4e39-8fab-57b55268eda5 tempest-FloatingIPsAssociationNegativeTestJSON-92980802 tempest-FloatingIPsAssociationNegativeTestJSON-92980802-project-member] Enqueued Resource ID: 28190eb0-e154-4896-a918-a81b5035d7b6 with Priority: HIGHEST for action security_group_members [ 876.455418] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28190eb0-e154-4896-a918-a81b5035d7b6 with Priority: HIGHEST for action security_group_members [ 876.455813] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28190eb0-e154-4896-a918-a81b5035d7b6 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.455953] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.457052] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.457356] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.457532] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.457688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.457688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.457860] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.457951] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.458057] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28190eb0-e154-4896-a918-a81b5035d7b6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.734077] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.739122] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-552 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.739122] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-552" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.739122] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-552" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.739122] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-552" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.739402] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.739893] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.740080] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.740370] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.740628] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.740767] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 876.740906] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 876.740986] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 876.741180] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 876.741242] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 876.741534] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 876.742138] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 876.761059] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 876.761059] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 876.761059] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 876.761059] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-552" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.761059] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-77131c94-c9f3-4568-b3d7-c61e5c6c0389 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.761314] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-77131c94-c9f3-4568-b3d7-c61e5c6c0389" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.761426] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-77131c94-c9f3-4568-b3d7-c61e5c6c0389" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.761685] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-77131c94-c9f3-4568-b3d7-c61e5c6c0389" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.761827] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77131c94-c9f3-4568-b3d7-c61e5c6c0389',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.963526] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.963697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.963769] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.964035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.964175] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.964418] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.964522] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.964571] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.964750] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.964824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.964907] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28190eb0-e154-4896-a918-a81b5035d7b6 already deleted. [ 876.965011] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.234517] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.264551] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.264773] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.264906] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.265364] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.265442] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.265535] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 77131c94-c9f3-4568-b3d7-c61e5c6c0389 not found, creating... [ 877.265819] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.265952] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.266170] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.266397] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.266546] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.267247] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.267427] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.267553] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.267789] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.267910] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.268084] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 77131c94-c9f3-4568-b3d7-c61e5c6c0389 is going to be created. [ 877.288052] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.288052] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.288052] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.288052] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.288392] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.288478] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-77131c94-c9f3-4568-b3d7-c61e5c6c0389" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.635332] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1068186a-ec83-4273-b088-3f5610ae229e in Status: SUCCESS [ 877.635567] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.635737] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.635962] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.636195] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.636338] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.636421] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.637689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.637689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.637689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.637689] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.642316] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.642316] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.642316] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.642316] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.642316] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.642316] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.642316] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.642316] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.737332] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.737534] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.737783] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.737783] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.737920] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.737958] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fab5e96-3f01-4c71-994f-69059ca62986 is going to be updated. [ 877.773132] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.773345] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.773345] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.773589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.773724] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.782912] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: IN_PROGRESS for 2s [ 878.012523] env[69559]: INFO networking_nsxv3.common.synchronization [req-d5d6a6b5-2ba7-4829-822d-b752867823d7 req-b1fe2c95-7b41-43f3-a49d-ed934289a890 service nova] Enqueued Resource ID: 28190eb0-e154-4896-a918-a81b5035d7b6 with Priority: HIGHEST for action security_group_rules [ 878.016159] env[69559]: INFO networking_nsxv3.common.synchronization [req-d5d6a6b5-2ba7-4829-822d-b752867823d7 req-b1fe2c95-7b41-43f3-a49d-ed934289a890 service nova] Enqueued Resource ID: 28190eb0-e154-4896-a918-a81b5035d7b6 with Priority: HIGHEST for action security_group_members [ 878.016159] env[69559]: INFO networking_nsxv3.common.synchronization [req-d5d6a6b5-2ba7-4829-822d-b752867823d7 req-b1fe2c95-7b41-43f3-a49d-ed934289a890 service nova] Enqueued Resource ID: 77131c94-c9f3-4568-b3d7-c61e5c6c0389 with Priority: HIGHEST for action port [ 878.016159] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28190eb0-e154-4896-a918-a81b5035d7b6 with Priority: HIGHEST for action security_group_rules [ 878.016159] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28190eb0-e154-4896-a918-a81b5035d7b6 with Priority: HIGHEST for action security_group_members [ 878.016159] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77131c94-c9f3-4568-b3d7-c61e5c6c0389 with Priority: HIGHEST for action port [ 878.016159] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28190eb0-e154-4896-a918-a81b5035d7b6 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.016159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.016159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.016159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.016159] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28190eb0-e154-4896-a918-a81b5035d7b6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.016159] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28190eb0-e154-4896-a918-a81b5035d7b6 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.016159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.016159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.016159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.016791] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.016791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.016857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.017278] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.017278] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.017278] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28190eb0-e154-4896-a918-a81b5035d7b6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.018534] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-77131c94-c9f3-4568-b3d7-c61e5c6c0389 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.021143] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77131c94-c9f3-4568-b3d7-c61e5c6c0389" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.021220] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77131c94-c9f3-4568-b3d7-c61e5c6c0389" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.021377] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77131c94-c9f3-4568-b3d7-c61e5c6c0389" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.021452] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77131c94-c9f3-4568-b3d7-c61e5c6c0389',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.100643] env[69559]: INFO networking_nsxv3.common.synchronization [req-2c944376-f281-4856-a725-a1b8c34ef17b req-319e572d-8f1c-4ec0-9782-4021e4e523ae tempest-AttachInterfacesUnderV243Test-114660582 tempest-AttachInterfacesUnderV243Test-114660582-project-member] Enqueued Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_members [ 878.101146] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1068186a-ec83-4273-b088-3f5610ae229e with Priority: HIGHEST for action security_group_members [ 878.101447] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-1068186a-ec83-4273-b088-3f5610ae229e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.101551] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.139027] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.141712] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.523625] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28190eb0-e154-4896-a918-a81b5035d7b6 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.523911] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.524281] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28190eb0-e154-4896-a918-a81b5035d7b6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.524856] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77131c94-c9f3-4568-b3d7-c61e5c6c0389 with status ACTIVE [ 878.525062] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.525186] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.525248] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.525452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.525537] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.525704] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.525795] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.525852] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.525991] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.526080] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.526255] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.526344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.526403] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.526535] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.526606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.526685] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77131c94-c9f3-4568-b3d7-c61e5c6c0389 is going to be updated. [ 878.547469] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.547617] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.547671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.547878] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.547980] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.548137] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77131c94-c9f3-4568-b3d7-c61e5c6c0389" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.641634] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1068186a-ec83-4273-b088-3f5610ae229e: rpc.has_security_group_logging(os_id): False [ 878.646796] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.667257] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.667407] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.667481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.668146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.668146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.668146] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.668146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.668516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.668516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.668516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.668593] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1068186a-ec83-4273-b088-3f5610ae229e is going to be updated. [ 878.739306] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.739544] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.739659] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.740008] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.740183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.757114] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1068186a-ec83-4273-b088-3f5610ae229e in Status: IN_PROGRESS for 2s [ 879.031791] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28190eb0-e154-4896-a918-a81b5035d7b6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.154437] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.154437] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.154437] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.154437] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.154437] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.154437] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1068186a-ec83-4273-b088-3f5610ae229e is going to be updated. [ 879.178412] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.178412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.178412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.178412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.178412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.184901] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1068186a-ec83-4273-b088-3f5610ae229e in Status: IN_PROGRESS for 2s [ 879.534456] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.534456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.534456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.534456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.534456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.534456] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28190eb0-e154-4896-a918-a81b5035d7b6 is going to be created. [ 879.556938] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.556938] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.557088] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.557192] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.557351] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.565830] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28190eb0-e154-4896-a918-a81b5035d7b6 in Status: UNINITIALIZED for 2s [ 879.792090] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: SUCCESS [ 879.792381] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.772739] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1068186a-ec83-4273-b088-3f5610ae229e in Status: SUCCESS [ 880.772739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.772739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.772739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.772739] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.196065] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1068186a-ec83-4273-b088-3f5610ae229e in Status: SUCCESS [ 881.196301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.196469] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.196689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.196912] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.197083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.197162] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.197327] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.197407] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.197909] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.293400] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.293549] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.293621] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.293829] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.293922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.294035] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1068186a-ec83-4273-b088-3f5610ae229e is going to be deleted. [ 881.342107] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.342223] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.342536] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.342536] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.342625] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.342667] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.575516] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28190eb0-e154-4896-a918-a81b5035d7b6 in Status: SUCCESS [ 881.575745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.576139] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.576230] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.576493] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.576574] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.576618] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.576732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.576815] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.577015] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.577015] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28190eb0-e154-4896-a918-a81b5035d7b6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.699921] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.700198] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.700314] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.700524] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.700634] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.700852] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.701515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.701600] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.701775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.701840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.702067] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1068186a-ec83-4273-b088-3f5610ae229e is going to be deleted. [ 881.731252] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.731435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.731509] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.731784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.731906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.732042] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.732197] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.732349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.732556] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.732696] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.732784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.732945] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.733060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.733180] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1068186a-ec83-4273-b088-3f5610ae229e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.082315] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28190eb0-e154-4896-a918-a81b5035d7b6 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.082315] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.082315] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.082315] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.082315] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.082315] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.082315] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.082315] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.082315] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.082315] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.082315] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28190eb0-e154-4896-a918-a81b5035d7b6 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.082315] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.082315] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.082315] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.082315] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.082315] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.083051] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.083051] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.083051] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.083051] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.083051] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28190eb0-e154-4896-a918-a81b5035d7b6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.238096] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.238483] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.238677] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.239033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.239323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.239636] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.239868] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.240066] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.240334] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.240889] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.240889] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1068186a-ec83-4273-b088-3f5610ae229e already deleted. [ 882.240889] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1068186a-ec83-4273-b088-3f5610ae229e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.586770] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28190eb0-e154-4896-a918-a81b5035d7b6: rpc.has_security_group_logging(os_id): False [ 882.604732] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.604732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.604732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.604732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.604732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.604732] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.604732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.604732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.605137] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.605137] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.605193] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.606026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.606026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.606026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.606026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.606026] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.606026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.606026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.606291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.606291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.606402] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28190eb0-e154-4896-a918-a81b5035d7b6 is going to be created. [ 882.666500] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.666702] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.666784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.667095] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.667325] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.678376] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28190eb0-e154-4896-a918-a81b5035d7b6 in Status: IN_PROGRESS for 2s [ 883.105943] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 883.105943] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 883.516387] env[69559]: INFO networking_nsxv3.common.synchronization [req-fc229129-f24b-43d3-a3d8-1f2fabf1d5ea req-904176af-0728-4001-8161-0d4b3dad0553 tempest-ImagesTestJSON-1150485476 tempest-ImagesTestJSON-1150485476-project-member] Enqueued Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 883.517278] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 883.518824] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.518824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.518824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.519181] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.519390] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.519545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.519647] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.519905] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.519971] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.520115] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.022597] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.023411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.023411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.023411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.023411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.023411] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.023608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.023608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.023869] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.023869] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.023869] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 is going to be updated. [ 884.053322] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.053322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.053322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.053774] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.054785] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.066654] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: IN_PROGRESS for 2s [ 884.234955] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-190 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.234955] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-190" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.234955] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-190" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.234955] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-190" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.235307] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.235307] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.235433] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.235655] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.235806] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.236189] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 884.236364] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 884.236488] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 884.236660] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 884.236806] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 884.236962] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 884.237127] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 884.254834] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 884.256170] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 884.256170] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 884.256170] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-190" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.256170] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-ce855408-bea8-4417-a3c4-83fbda90d5d4 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.256471] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-ce855408-bea8-4417-a3c4-83fbda90d5d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.256667] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-ce855408-bea8-4417-a3c4-83fbda90d5d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.257162] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-ce855408-bea8-4417-a3c4-83fbda90d5d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.257411] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce855408-bea8-4417-a3c4-83fbda90d5d4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.694440] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28190eb0-e154-4896-a918-a81b5035d7b6 in Status: SUCCESS [ 884.694440] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.762798] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.763070] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.763559] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.763559] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.763667] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.763840] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port ce855408-bea8-4417-a3c4-83fbda90d5d4 not found, creating... [ 884.764577] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.764778] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.765040] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.765195] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.765352] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.766110] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.766110] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.766110] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.766285] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.766359] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.767277] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: ce855408-bea8-4417-a3c4-83fbda90d5d4 is going to be created. [ 884.789978] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.790356] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.790582] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.790970] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.791835] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.791987] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-ce855408-bea8-4417-a3c4-83fbda90d5d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.619964] env[69559]: INFO networking_nsxv3.common.synchronization [req-fc229129-f24b-43d3-a3d8-1f2fabf1d5ea req-d7e1d56e-8301-4fbb-ba39-e3f0bdea6ecc service nova] Enqueued Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_rules [ 885.620282] env[69559]: INFO networking_nsxv3.common.synchronization [req-fc229129-f24b-43d3-a3d8-1f2fabf1d5ea req-d7e1d56e-8301-4fbb-ba39-e3f0bdea6ecc service nova] Enqueued Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 885.620401] env[69559]: INFO networking_nsxv3.common.synchronization [req-fc229129-f24b-43d3-a3d8-1f2fabf1d5ea req-d7e1d56e-8301-4fbb-ba39-e3f0bdea6ecc service nova] Enqueued Resource ID: ce855408-bea8-4417-a3c4-83fbda90d5d4 with Priority: HIGHEST for action port [ 885.621103] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_rules [ 885.621244] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 885.621346] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce855408-bea8-4417-a3c4-83fbda90d5d4 with Priority: HIGHEST for action port [ 885.622275] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.622454] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.622913] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.622913] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.622913] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.624783] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.625056] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.625426] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce855408-bea8-4417-a3c4-83fbda90d5d4 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.626022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce855408-bea8-4417-a3c4-83fbda90d5d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.626022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce855408-bea8-4417-a3c4-83fbda90d5d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.626022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce855408-bea8-4417-a3c4-83fbda90d5d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.626022] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce855408-bea8-4417-a3c4-83fbda90d5d4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.076766] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: SUCCESS [ 886.078435] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 deletion is rescheduled due to dependency. [ 886.078435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.078435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.078435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.078435] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.078435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.078435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.078435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.078435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.078435] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.128690] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.128690] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.128690] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce855408-bea8-4417-a3c4-83fbda90d5d4 with status ACTIVE [ 886.128690] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.128690] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.128906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.129059] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.129470] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.129470] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.129470] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.129470] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.129624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.130173] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.130173] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.130173] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.130173] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.130173] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.130381] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.130381] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce855408-bea8-4417-a3c4-83fbda90d5d4 is going to be updated. [ 886.149933] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.150152] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.150226] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.150423] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.150584] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.150733] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce855408-bea8-4417-a3c4-83fbda90d5d4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.580504] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.084322] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.097309] env[69559]: INFO networking_nsxv3.common.synchronization [None req-0b66629e-3a5e-469e-a8eb-2c68e748bc4f tempest-ServerRescueNegativeTestJSON-1113411482 tempest-ServerRescueNegativeTestJSON-1113411482-project-member] Enqueued Resource ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 with Priority: HIGHEST for action security_group_rules [ 887.098220] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 with Priority: HIGHEST for action security_group_rules [ 887.099975] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.100114] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.100187] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.100442] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.100523] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.310164] env[69559]: INFO networking_nsxv3.common.synchronization [None req-eac72406-8f65-41ce-8c89-e3df64d711dc tempest-ServerRescueNegativeTestJSON-1113411482 tempest-ServerRescueNegativeTestJSON-1113411482-project-member] Enqueued Resource ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 with Priority: HIGHEST for action security_group_rules [ 887.310731] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 with Priority: HIGHEST for action security_group_rules [ 887.311058] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.311171] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.587160] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.587334] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.587433] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.587688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.587839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.587969] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 is going to be updated. [ 887.617115] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.617115] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.617115] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.617115] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.617115] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.623788] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.623788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.623788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.623788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.623788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.623788] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 already deleted. [ 887.623788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.623788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.623788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.623788] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.625979] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: IN_PROGRESS for 2s [ 888.142706] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.143035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.143035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.143215] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.143261] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.143367] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 already deleted. [ 888.143437] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.635307] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: SUCCESS [ 889.635603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.635985] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.635985] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.636167] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.636287] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.636347] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.636496] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.636578] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.636795] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.636925] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.140574] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.140574] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.140574] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.140744] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.140867] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.141059] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.141123] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.141340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.141451] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.142031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.142031] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.142031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.142031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.142031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.143198] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.143198] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.143198] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.143198] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.143198] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.143198] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.143198] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.189078] env[69559]: INFO networking_nsxv3.common.synchronization [req-209e79bf-82cc-4adf-b6d2-b645ee5e916e req-c3472eb0-50f4-46a6-8189-8efd5b567501 tempest-ServersNegativeTestJSON-583757154 tempest-ServersNegativeTestJSON-583757154-project-member] Enqueued Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGHEST for action security_group_members [ 890.189623] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGHEST for action security_group_members [ 890.189942] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.190112] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.190164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.190348] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.190505] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.190608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.190659] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.190801] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.190886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.190980] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.535208] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-286 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.535407] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-286" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.535407] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-286" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.536033] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-286" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.536033] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.536201] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.536201] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.536415] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.536561] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.536767] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.536885] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 890.537048] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 890.537166] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 890.537291] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.537398] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 890.537532] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 890.557163] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 890.557363] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 890.557533] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 890.557745] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-286" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.558106] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-4c3c7e91-4eed-4d8f-8c42-9dfb1d6cc96f taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.558295] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-4c3c7e91-4eed-4d8f-8c42-9dfb1d6cc96f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.558421] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-4c3c7e91-4eed-4d8f-8c42-9dfb1d6cc96f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.558771] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-4c3c7e91-4eed-4d8f-8c42-9dfb1d6cc96f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.558924] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c3c7e91-4eed-4d8f-8c42-9dfb1d6cc96f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.645384] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55a5191b-a436-4df6-a235-6b2c46e6eea7: rpc.has_security_group_logging(os_id): False [ 890.662708] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.662859] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.662930] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.663170] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.663248] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.663474] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.663591] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.663653] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.663817] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.663894] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.664327] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.664450] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.664513] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.664658] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.664734] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.664926] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.665035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.665097] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.665252] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.665344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.665431] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 is going to be updated. [ 890.693575] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.725791] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.725946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.726092] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.726265] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.726411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.738418] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: IN_PROGRESS for 2s [ 891.062161] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.062400] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.062527] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.062827] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.062982] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.063160] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 4c3c7e91-4eed-4d8f-8c42-9dfb1d6cc96f not found, creating... [ 891.063420] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.063705] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.063705] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.065122] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.065122] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.065122] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.065122] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.065122] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.065122] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.065122] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.066025] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 4c3c7e91-4eed-4d8f-8c42-9dfb1d6cc96f is going to be created. [ 891.084633] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.084888] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.085032] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.085320] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.085553] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.085777] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-4c3c7e91-4eed-4d8f-8c42-9dfb1d6cc96f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.195770] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.701854] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.701854] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.702431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.702431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.702431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.702582] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 is going to be updated. [ 891.727734] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.728111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.728365] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.729200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.729286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.738902] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 in Status: IN_PROGRESS for 2s [ 891.870651] env[69559]: INFO networking_nsxv3.common.synchronization [req-209e79bf-82cc-4adf-b6d2-b645ee5e916e req-60488b76-1ecd-4bb0-a8b5-8be82da2a50e service nova] Enqueued Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGHEST for action security_group_rules [ 891.870895] env[69559]: INFO networking_nsxv3.common.synchronization [req-209e79bf-82cc-4adf-b6d2-b645ee5e916e req-60488b76-1ecd-4bb0-a8b5-8be82da2a50e service nova] Enqueued Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGHEST for action security_group_members [ 891.871999] env[69559]: INFO networking_nsxv3.common.synchronization [req-209e79bf-82cc-4adf-b6d2-b645ee5e916e req-60488b76-1ecd-4bb0-a8b5-8be82da2a50e service nova] Enqueued Resource ID: 4c3c7e91-4eed-4d8f-8c42-9dfb1d6cc96f with Priority: HIGHEST for action port [ 891.871999] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGHEST for action security_group_rules [ 891.871999] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGHEST for action security_group_members [ 891.871999] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c3c7e91-4eed-4d8f-8c42-9dfb1d6cc96f with Priority: HIGHEST for action port [ 891.874172] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbcf9733-e0a4-4cd5-bcff-a59904ddee14 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.874172] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.874172] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.874172] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.874172] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.874172] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.874172] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.874679] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c3c7e91-4eed-4d8f-8c42-9dfb1d6cc96f taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.874679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c3c7e91-4eed-4d8f-8c42-9dfb1d6cc96f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.874679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c3c7e91-4eed-4d8f-8c42-9dfb1d6cc96f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.874791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c3c7e91-4eed-4d8f-8c42-9dfb1d6cc96f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.874791] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c3c7e91-4eed-4d8f-8c42-9dfb1d6cc96f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.377142] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.378081] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.378434] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c3c7e91-4eed-4d8f-8c42-9dfb1d6cc96f with status ACTIVE [ 892.380745] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.380745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.380745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.380745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.380745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.380745] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.380745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.380745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.380745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.380745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.382030] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.382030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.382030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.382030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.382030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.382030] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c3c7e91-4eed-4d8f-8c42-9dfb1d6cc96f is going to be updated. [ 892.402850] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.403078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.403078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.403339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.403479] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.403761] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c3c7e91-4eed-4d8f-8c42-9dfb1d6cc96f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.753785] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: SUCCESS [ 892.754096] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.753428] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 in Status: SUCCESS [ 893.753694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.753876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.754114] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.754299] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.754416] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.754479] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.754630] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.754707] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.754802] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.257536] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.761657] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.264330] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.264493] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.264564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.264781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.264870] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.264971] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 is going to be updated. [ 895.290691] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.290826] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.290960] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.291127] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.291271] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.301028] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 in Status: IN_PROGRESS for 2s [ 896.873130] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 896.873130] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 897.281021] env[69559]: INFO networking_nsxv3.common.synchronization [req-fd07c1f5-15e3-40d7-9273-41b7033dde79 req-aa6acc71-d2d7-4cc4-b655-011eb51ea3d8 tempest-FloatingIPsAssociationNegativeTestJSON-92980802 tempest-FloatingIPsAssociationNegativeTestJSON-92980802-project-member] Enqueued Resource ID: 28190eb0-e154-4896-a918-a81b5035d7b6 with Priority: HIGHEST for action security_group_members [ 897.283198] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28190eb0-e154-4896-a918-a81b5035d7b6 with Priority: HIGHEST for action security_group_members [ 897.283552] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28190eb0-e154-4896-a918-a81b5035d7b6 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.283811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.283991] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.284363] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.284630] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.284858] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.285033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.285303] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.285496] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.285711] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28190eb0-e154-4896-a918-a81b5035d7b6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.314090] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 in Status: SUCCESS [ 897.314090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.314090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.314090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.314090] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.314090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.314090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.314090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.314090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.314090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.314090] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.789177] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.789177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.789177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.789378] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.789501] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.790547] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.790547] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.790547] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.790547] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.790547] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.790547] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28190eb0-e154-4896-a918-a81b5035d7b6 is going to be updated. [ 897.799503] env[69559]: INFO networking_nsxv3.common.synchronization [req-55ffc9c4-d0c7-4d2e-9743-c8f5e2b18869 req-40be868e-0bba-4541-9dbd-049b37c4bf94 tempest-ServersAdminTestJSON-1923717545 tempest-ServersAdminTestJSON-1923717545-project-member] Enqueued Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 897.800043] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 897.803047] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.803047] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.803047] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.803047] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.803047] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.803047] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.803047] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.803047] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.803047] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.803047] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.817517] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.817851] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.820606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.820606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.820606] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.820606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.820606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.820606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.820606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.820606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.820606] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.820606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.820606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.820606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.820606] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.820606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.820606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.820606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.820606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.820606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.822335] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.822335] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.822335] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.822335] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.822335] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.822546] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.834069] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28190eb0-e154-4896-a918-a81b5035d7b6 in Status: IN_PROGRESS for 2s [ 898.111144] env[69559]: INFO networking_nsxv3.common.synchronization [req-bcc2b510-87ae-46c0-a395-9875e924f786 req-406c208f-25bc-4452-bf51-93f499ef5ea9 tempest-ListServerFiltersTestJSON-1483085772 tempest-ListServerFiltersTestJSON-1483085772-project-member] Enqueued Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_members [ 898.111725] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_members [ 898.114783] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.114898] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.114898] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.115527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.115527] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.115527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.115527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.115715] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.115715] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.115776] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.305073] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.325229] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbcf9733-e0a4-4cd5-bcff-a59904ddee14: rpc.has_security_group_logging(os_id): False [ 898.344713] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.344713] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.344713] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.344868] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.344946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.346019] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.346019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.346019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.346019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.346019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.346019] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.346019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.346019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.346019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.346019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.346451] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.346451] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.346451] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.346785] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.346785] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.346785] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 is going to be updated. [ 898.405754] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.406298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.406298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.407327] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.407327] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.420819] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 in Status: IN_PROGRESS for 2s [ 898.537866] env[69559]: INFO networking_nsxv3.common.synchronization [req-3abf696f-972c-4121-b8d4-a11f5cabc4aa req-8e09fdb1-444e-4dbe-ae79-5eb83bcdaba9 tempest-ServerRescueTestJSON-155966181 tempest-ServerRescueTestJSON-155966181-project-member] Enqueued Resource ID: 734f0202-8a2d-48a6-8b16-336653a0c857 with Priority: HIGHEST for action security_group_members [ 898.538412] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 734f0202-8a2d-48a6-8b16-336653a0c857 with Priority: HIGHEST for action security_group_members [ 898.538714] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-734f0202-8a2d-48a6-8b16-336653a0c857 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.538841] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.538944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.539490] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.539775] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.539775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.539912] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.539964] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.540037] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.540374] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.623134] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.623134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.623134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.623134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.623353] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.623557] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.623557] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.623692] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.623775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.623866] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.623962] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf already deleted. [ 898.624069] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.807803] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.043645] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.043780] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.044800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.046172] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.046567] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.046927] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.049014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.049014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.049014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.049014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.049014] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 734f0202-8a2d-48a6-8b16-336653a0c857 is going to be updated. [ 899.076943] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.077152] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.077222] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.077784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.077784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.089422] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 734f0202-8a2d-48a6-8b16-336653a0c857 in Status: IN_PROGRESS for 2s [ 899.316156] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.316156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.316156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.316156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.316156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.316156] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fab5e96-3f01-4c71-994f-69059ca62986 is going to be updated. [ 899.322031] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.322490] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-243" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.322490] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-243" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.322736] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-243" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.323041] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.323268] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.323370] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.323615] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.323765] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.323975] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.324517] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.324660] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.324829] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.325190] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.325190] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.325190] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.345905] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.346356] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 899.346356] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.346473] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-243" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.347158] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-99974978-e4f1-437e-afb3-643cd0e42dcd taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.347408] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-99974978-e4f1-437e-afb3-643cd0e42dcd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.347581] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-99974978-e4f1-437e-afb3-643cd0e42dcd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.347931] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-99974978-e4f1-437e-afb3-643cd0e42dcd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.348132] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99974978-e4f1-437e-afb3-643cd0e42dcd',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.353519] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.353693] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.353788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.354031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.354325] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.363403] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: IN_PROGRESS for 2s [ 899.842872] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28190eb0-e154-4896-a918-a81b5035d7b6 in Status: SUCCESS [ 899.846031] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28190eb0-e154-4896-a918-a81b5035d7b6 deletion is rescheduled due to dependency. [ 899.846031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.850763] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.851020] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.851157] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.851504] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.851670] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.852044] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 99974978-e4f1-437e-afb3-643cd0e42dcd not found, creating... [ 899.852263] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.852348] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.852553] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.852678] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.852816] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.853155] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.853367] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.853484] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.854216] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.854216] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.854216] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 99974978-e4f1-437e-afb3-643cd0e42dcd is going to be created. [ 899.873774] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.873774] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.873774] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.875035] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.875035] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.875035] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-99974978-e4f1-437e-afb3-643cd0e42dcd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.204149] env[69559]: INFO networking_nsxv3.common.synchronization [req-91f5daa5-57da-4443-9c21-7d4d121b53ff req-0ab75cd0-b98a-49f5-a4ee-5f6d8a75fe4e tempest-ListServerFiltersTestJSON-1483085772 tempest-ListServerFiltersTestJSON-1483085772-project-member] Enqueued Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_members [ 900.204680] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_members [ 900.205038] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.205153] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.205185] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.205528] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.205528] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.205677] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.205677] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.205811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.205896] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.205987] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.435775] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 in Status: SUCCESS [ 900.436030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.711042] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.711241] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.711297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.711515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.711603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.711803] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.711901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.712028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.712150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.712234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.712372] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf already deleted. [ 900.712430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.736937] env[69559]: INFO networking_nsxv3.common.synchronization [None req-23097fd0-1cb8-4775-b436-ba05a8c20c09 None None] Enqueued Resource ID: 61330fb9-c524-4e2c-9a8b-fcdc213638f2 with Priority: HIGHEST for action port [ 900.737342] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61330fb9-c524-4e2c-9a8b-fcdc213638f2 with Priority: HIGHEST for action port [ 900.738137] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-61330fb9-c524-4e2c-9a8b-fcdc213638f2 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.738331] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61330fb9-c524-4e2c-9a8b-fcdc213638f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.738394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61330fb9-c524-4e2c-9a8b-fcdc213638f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.738725] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61330fb9-c524-4e2c-9a8b-fcdc213638f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.738834] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61330fb9-c524-4e2c-9a8b-fcdc213638f2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.773931] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.775106] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-243" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.775106] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-243" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.775106] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-243" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.775106] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.775106] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.775525] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.775919] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.776105] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.776323] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 900.776443] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 900.776557] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 900.776669] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 900.776781] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 900.776890] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 900.777463] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 900.796679] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 900.796889] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 900.797046] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 900.797286] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-243" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.797546] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-f6b8ef30-1197-4b59-9759-5e23bdc51add taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.797728] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-f6b8ef30-1197-4b59-9759-5e23bdc51add" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.797865] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-f6b8ef30-1197-4b59-9759-5e23bdc51add" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.798240] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-f6b8ef30-1197-4b59-9759-5e23bdc51add" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.798406] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6b8ef30-1197-4b59-9759-5e23bdc51add',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.942940] env[69559]: INFO networking_nsxv3.common.synchronization [req-bcc2b510-87ae-46c0-a395-9875e924f786 req-865e931b-a99a-43f7-ae84-efdff8d463e2 service nova] Enqueued Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_rules [ 900.943165] env[69559]: INFO networking_nsxv3.common.synchronization [req-bcc2b510-87ae-46c0-a395-9875e924f786 req-865e931b-a99a-43f7-ae84-efdff8d463e2 service nova] Enqueued Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_members [ 900.943311] env[69559]: INFO networking_nsxv3.common.synchronization [req-bcc2b510-87ae-46c0-a395-9875e924f786 req-865e931b-a99a-43f7-ae84-efdff8d463e2 service nova] Enqueued Resource ID: 99974978-e4f1-437e-afb3-643cd0e42dcd with Priority: HIGHEST for action port [ 900.943847] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_rules [ 900.944505] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_members [ 900.944690] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99974978-e4f1-437e-afb3-643cd0e42dcd with Priority: HIGHEST for action port [ 900.945029] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.945199] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.945340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.945602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.945741] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.947105] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.947716] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.947856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.948085] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.948295] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.948426] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.948513] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.948686] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.948809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.948929] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.949833] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-99974978-e4f1-437e-afb3-643cd0e42dcd taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.949933] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99974978-e4f1-437e-afb3-643cd0e42dcd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.950011] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99974978-e4f1-437e-afb3-643cd0e42dcd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.950415] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99974978-e4f1-437e-afb3-643cd0e42dcd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.950415] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99974978-e4f1-437e-afb3-643cd0e42dcd',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.101943] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 734f0202-8a2d-48a6-8b16-336653a0c857 in Status: SUCCESS [ 901.102205] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 734f0202-8a2d-48a6-8b16-336653a0c857 deletion is rescheduled due to dependency. [ 901.102367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.244401] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61330fb9-c524-4e2c-9a8b-fcdc213638f2 [ 901.244824] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.244959] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.244959] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.245179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.245270] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.245669] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61330fb9-c524-4e2c-9a8b-fcdc213638f2 already deleted. [ 901.245669] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61330fb9-c524-4e2c-9a8b-fcdc213638f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.301677] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.301934] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.302367] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.302367] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.302531] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.302696] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port f6b8ef30-1197-4b59-9759-5e23bdc51add not found, creating... [ 901.302983] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.303169] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.303283] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.303510] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.303633] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.303913] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.304081] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.304245] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.304952] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.305108] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.305257] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: f6b8ef30-1197-4b59-9759-5e23bdc51add is going to be created. [ 901.322526] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.322982] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.323184] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.323522] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.323804] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.324086] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-f6b8ef30-1197-4b59-9759-5e23bdc51add" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.373568] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: SUCCESS [ 901.374722] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.452396] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.452680] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.453165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.458153] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99974978-e4f1-437e-afb3-643cd0e42dcd with status ACTIVE [ 901.458364] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.458490] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.458555] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.458778] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.458868] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.459203] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.461032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.461032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.461032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.461032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.461032] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.461032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.461032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.461032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.461032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.461032] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99974978-e4f1-437e-afb3-643cd0e42dcd is going to be updated. [ 901.478993] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.479247] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.479321] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.479630] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.483018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.483018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99974978-e4f1-437e-afb3-643cd0e42dcd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.954549] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.357439] env[69559]: INFO networking_nsxv3.common.synchronization [req-91f5daa5-57da-4443-9c21-7d4d121b53ff req-e2b2a95a-3cd2-4df4-a585-55099225152f service nova] Enqueued Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_rules [ 902.357439] env[69559]: INFO networking_nsxv3.common.synchronization [req-91f5daa5-57da-4443-9c21-7d4d121b53ff req-e2b2a95a-3cd2-4df4-a585-55099225152f service nova] Enqueued Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_members [ 902.357439] env[69559]: INFO networking_nsxv3.common.synchronization [req-91f5daa5-57da-4443-9c21-7d4d121b53ff req-e2b2a95a-3cd2-4df4-a585-55099225152f service nova] Enqueued Resource ID: f6b8ef30-1197-4b59-9759-5e23bdc51add with Priority: HIGHEST for action port [ 902.357439] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_rules [ 902.357439] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_members [ 902.357439] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b8ef30-1197-4b59-9759-5e23bdc51add with Priority: HIGHEST for action port [ 902.357714] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.357804] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.358116] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.358247] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.358473] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6b8ef30-1197-4b59-9759-5e23bdc51add taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.358575] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6b8ef30-1197-4b59-9759-5e23bdc51add" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.358636] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6b8ef30-1197-4b59-9759-5e23bdc51add" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.358891] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6b8ef30-1197-4b59-9759-5e23bdc51add" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.358970] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6b8ef30-1197-4b59-9759-5e23bdc51add',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.456972] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.458270] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.458270] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.458270] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.458270] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.458270] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf is going to be created. [ 902.482442] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.482643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.482742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.483744] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.483744] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.492084] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf in Status: UNINITIALIZED for 2s [ 902.845191] env[69559]: INFO networking_nsxv3.common.synchronization [None req-17ea4caa-ed97-4bf9-b9c5-6fba8bfb921a None None] Enqueued Resource ID: 1e4963a7-69b4-406f-8a2a-138ab580542b with Priority: HIGHEST for action port [ 902.845452] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e4963a7-69b4-406f-8a2a-138ab580542b with Priority: HIGHEST for action port [ 902.846212] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e4963a7-69b4-406f-8a2a-138ab580542b taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.846335] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e4963a7-69b4-406f-8a2a-138ab580542b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.846391] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e4963a7-69b4-406f-8a2a-138ab580542b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.846651] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e4963a7-69b4-406f-8a2a-138ab580542b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.846730] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e4963a7-69b4-406f-8a2a-138ab580542b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.861578] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6b8ef30-1197-4b59-9759-5e23bdc51add with status ACTIVE [ 902.862076] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.862076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.862076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.862282] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.862387] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.862515] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.862613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.862674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.862981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.863080] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.863198] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.863292] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.863351] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.864656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.864725] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.864903] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6b8ef30-1197-4b59-9759-5e23bdc51add is going to be updated. [ 902.886193] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.887256] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.887376] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.887715] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.887715] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.887869] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6b8ef30-1197-4b59-9759-5e23bdc51add" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.350694] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e4963a7-69b4-406f-8a2a-138ab580542b [ 903.350694] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.350694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.350694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.350694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.350694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.350694] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e4963a7-69b4-406f-8a2a-138ab580542b already deleted. [ 903.350694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e4963a7-69b4-406f-8a2a-138ab580542b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.452137] env[69559]: INFO networking_nsxv3.common.synchronization [None req-e7935d23-8c34-4b57-8920-db1494949d3a None None] Enqueued Resource ID: b5421b02-5b77-4331-885b-f733501662c3 with Priority: HIGHEST for action port [ 903.452137] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5421b02-5b77-4331-885b-f733501662c3 with Priority: HIGHEST for action port [ 903.452455] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5421b02-5b77-4331-885b-f733501662c3 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.452569] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5421b02-5b77-4331-885b-f733501662c3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.452634] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5421b02-5b77-4331-885b-f733501662c3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.452877] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5421b02-5b77-4331-885b-f733501662c3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.452958] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5421b02-5b77-4331-885b-f733501662c3',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.584401] env[69559]: INFO networking_nsxv3.common.synchronization [req-c926d209-06c9-495c-8aa2-73c51cded1a1 req-cef45502-ae39-4dd7-8951-ea96d26709a5 tempest-ServersNegativeTestJSON-583757154 tempest-ServersNegativeTestJSON-583757154-project-member] Enqueued Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGHEST for action security_group_members [ 903.588459] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGHEST for action security_group_members [ 903.588459] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.588459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.588459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.588459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.588459] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.588459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.588459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.588459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.588459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.588459] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.962198] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5421b02-5b77-4331-885b-f733501662c3 [ 903.962464] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.962597] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.962666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.962874] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.962957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.963059] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5421b02-5b77-4331-885b-f733501662c3 already deleted. [ 903.963136] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5421b02-5b77-4331-885b-f733501662c3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.031245] env[69559]: INFO networking_nsxv3.common.synchronization [None req-dae41a7e-d72c-481e-b6ed-584d1434dc9c tempest-ServersV294TestFqdnHostnames-516618000 tempest-ServersV294TestFqdnHostnames-516618000-project-member] Enqueued Resource ID: 67da4308-465f-4939-8941-41bacf52a39e with Priority: HIGHEST for action security_group_rules [ 904.031786] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67da4308-465f-4939-8941-41bacf52a39e with Priority: HIGHEST for action security_group_rules [ 904.032114] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67da4308-465f-4939-8941-41bacf52a39e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.032343] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.032413] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.032877] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.032877] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67da4308-465f-4939-8941-41bacf52a39e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.092964] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.145308] env[69559]: INFO networking_nsxv3.common.synchronization [None req-de436c08-b24a-43a1-829c-66fa6d6f5732 tempest-ServersV294TestFqdnHostnames-516618000 tempest-ServersV294TestFqdnHostnames-516618000-project-member] Enqueued Resource ID: 67da4308-465f-4939-8941-41bacf52a39e with Priority: HIGHEST for action security_group_rules [ 904.145308] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67da4308-465f-4939-8941-41bacf52a39e with Priority: HIGHEST for action security_group_rules [ 904.145308] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67da4308-465f-4939-8941-41bacf52a39e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.145308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.503496] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf in Status: SUCCESS [ 904.503742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.504442] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.504442] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.504442] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.504646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.504646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.504790] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.504886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.504974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.505127] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.509227] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.509452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.509594] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.509703] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.509767] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.509909] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.509986] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.511054] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.552237] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.552237] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.552237] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.552454] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.552539] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.552636] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67da4308-465f-4939-8941-41bacf52a39e already deleted. [ 904.552718] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.553242] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.553649] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.553649] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67da4308-465f-4939-8941-41bacf52a39e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.595145] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.009856] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.009856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.012950] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.076860] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.078032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.079068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.079310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.079453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.079634] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67da4308-465f-4939-8941-41bacf52a39e already deleted. [ 905.079748] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.101286] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.101286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.101286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.101286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.101286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.101286] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 is going to be updated. [ 905.126077] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.126231] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.126298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.126515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.126677] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.135387] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 in Status: IN_PROGRESS for 2s [ 905.204266] env[69559]: INFO networking_nsxv3.common.synchronization [None req-2d26b6ce-9a12-45b0-a802-1aecff58aa00 None None] Enqueued Resource ID: e048fea2-2e91-4fea-bd61-4791c7b401ef with Priority: HIGHEST for action port [ 905.204742] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e048fea2-2e91-4fea-bd61-4791c7b401ef with Priority: HIGHEST for action port [ 905.205084] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-e048fea2-2e91-4fea-bd61-4791c7b401ef taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.205228] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e048fea2-2e91-4fea-bd61-4791c7b401ef" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.205318] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e048fea2-2e91-4fea-bd61-4791c7b401ef" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.205617] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e048fea2-2e91-4fea-bd61-4791c7b401ef" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.205707] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e048fea2-2e91-4fea-bd61-4791c7b401ef',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.515866] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.713036] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e048fea2-2e91-4fea-bd61-4791c7b401ef [ 905.713036] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.713036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.713036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.713441] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.713441] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.713441] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e048fea2-2e91-4fea-bd61-4791c7b401ef already deleted. [ 905.713441] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e048fea2-2e91-4fea-bd61-4791c7b401ef" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.976990] env[69559]: INFO networking_nsxv3.common.synchronization [req-454fa16b-3efe-4673-9be4-52907e536749 req-8ca86bd7-258b-4bbf-b74a-93aac5593320 tempest-ListServerFiltersTestJSON-1483085772 tempest-ListServerFiltersTestJSON-1483085772-project-member] Enqueued Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_members [ 905.977593] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_members [ 905.977933] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.978179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.018604] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.018942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.019176] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.019412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.019511] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.019614] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf is going to be updated. [ 906.045434] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.045613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.045717] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.045929] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.046256] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.055279] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf in Status: IN_PROGRESS for 2s [ 906.277541] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.277753] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-243" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.277884] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-243" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.278180] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-243" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.278468] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.278620] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.278746] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.278968] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.279446] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.279598] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 906.279715] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 906.279833] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 906.279936] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 906.280064] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 906.280291] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 906.280352] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 906.297695] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 906.297872] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 906.298033] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 906.298231] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-243" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.298553] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-3c1ac637-422a-4a64-a98a-673922fdca29 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.298732] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-3c1ac637-422a-4a64-a98a-673922fdca29" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.298857] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-3c1ac637-422a-4a64-a98a-673922fdca29" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.299270] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-3c1ac637-422a-4a64-a98a-673922fdca29" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.299415] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c1ac637-422a-4a64-a98a-673922fdca29',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.754491] env[69559]: INFO networking_nsxv3.common.synchronization [req-804a9a81-97cf-43e5-9321-e204ea585908 req-12ed9b04-5342-4cd1-95e9-53d375d45eef tempest-ServerActionsV293TestJSON-791060682 tempest-ServerActionsV293TestJSON-791060682-project-member] Enqueued Resource ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf with Priority: HIGHEST for action security_group_members [ 906.756972] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf with Priority: HIGHEST for action security_group_members [ 906.756972] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-9bd39e16-65ec-4813-afc3-35754d24a5bf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.756972] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.756972] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.756972] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.756972] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.756972] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.756972] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.756972] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.756972] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.756972] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9bd39e16-65ec-4813-afc3-35754d24a5bf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.802410] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.802410] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.802660] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.802708] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.802856] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.803040] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 3c1ac637-422a-4a64-a98a-673922fdca29 not found, creating... [ 906.803341] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.803508] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.803627] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.803857] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.803996] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.804298] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.804451] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.804570] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.804782] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.804912] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.805087] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 3c1ac637-422a-4a64-a98a-673922fdca29 is going to be created. [ 906.824830] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.825171] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.825363] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.825709] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.827501] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.827603] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-3c1ac637-422a-4a64-a98a-673922fdca29" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.145997] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 in Status: IN_PROGRESS for 4s [ 907.265355] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.265355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.265355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.265355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.265355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.265355] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.265355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.265355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.265355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.265355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.265355] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf is going to be updated. [ 907.291991] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.292616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.292616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.292769] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.293531] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.303163] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf in Status: IN_PROGRESS for 2s [ 908.036630] env[69559]: INFO networking_nsxv3.common.synchronization [req-454fa16b-3efe-4673-9be4-52907e536749 req-a2068ef6-d285-4b38-9ba0-85b8026c80b9 service nova] Enqueued Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_rules [ 908.036910] env[69559]: INFO networking_nsxv3.common.synchronization [req-454fa16b-3efe-4673-9be4-52907e536749 req-a2068ef6-d285-4b38-9ba0-85b8026c80b9 service nova] Enqueued Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_members [ 908.036910] env[69559]: INFO networking_nsxv3.common.synchronization [req-454fa16b-3efe-4673-9be4-52907e536749 req-a2068ef6-d285-4b38-9ba0-85b8026c80b9 service nova] Enqueued Resource ID: 3c1ac637-422a-4a64-a98a-673922fdca29 with Priority: HIGHEST for action port [ 908.038164] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_rules [ 908.038413] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_members [ 908.038561] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c1ac637-422a-4a64-a98a-673922fdca29 with Priority: HIGHEST for action port [ 908.038914] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.039107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.039419] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.039591] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.039825] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c1ac637-422a-4a64-a98a-673922fdca29 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.040033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c1ac637-422a-4a64-a98a-673922fdca29" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.040110] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c1ac637-422a-4a64-a98a-673922fdca29" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.040375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c1ac637-422a-4a64-a98a-673922fdca29" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.040514] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c1ac637-422a-4a64-a98a-673922fdca29',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.076518] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf in Status: SUCCESS [ 908.076798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.081322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.081609] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.081823] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.081948] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.082026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.082204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.082320] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.082441] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.082649] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.082758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.082838] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.083143] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.083344] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.084025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.084025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.084025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.084025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.084025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.084025] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.085221] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.085446] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.085620] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.085674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.085742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.085881] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.085960] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.086065] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.544151] env[69559]: INFO networking_nsxv3.common.synchronization [req-418ca192-959a-4b00-acc1-4cc73cc277cc req-4f377963-c73b-4671-982d-08735269203b tempest-ServerRescueNegativeTestJSON-1113411482 tempest-ServerRescueNegativeTestJSON-1113411482-project-member] Enqueued Resource ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 with Priority: HIGHEST for action security_group_members [ 908.544151] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3c1ac637-422a-4a64-a98a-673922fdca29 with status ACTIVE [ 908.544151] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.544151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.544151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.544151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.544151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.544151] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.544151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.544151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.544151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.545114] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.545484] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.545731] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.546783] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.547289] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.547718] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.547718] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3c1ac637-422a-4a64-a98a-673922fdca29 is going to be updated. [ 908.552705] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 with Priority: HIGHEST for action security_group_members [ 908.552705] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.552705] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.552705] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.552705] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.552705] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.552705] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.553234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.553234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.553234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.553367] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.574351] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.574843] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.574843] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.574843] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.574975] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.576032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c1ac637-422a-4a64-a98a-673922fdca29" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.588106] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7f662d8-9904-44e6-8a35-051e2c4e15cf: rpc.has_security_group_logging(os_id): False [ 908.589243] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.606419] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.606583] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.606647] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.606852] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.606939] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.607203] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.607305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.607364] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.608074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.608074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.608074] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.608074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.608074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.608074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.608296] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.608324] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.608414] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.608475] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.608610] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.608683] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.608766] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf is going to be created. [ 908.671799] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.671992] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.672106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.672602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.672602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.687850] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf in Status: IN_PROGRESS for 2s [ 908.985041] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-284 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.985460] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-284" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.985651] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-284" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.986037] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-284" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.986374] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.986551] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.987082] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.988035] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.988035] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.988629] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 908.988629] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 908.988629] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 908.988720] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 908.989115] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 908.989115] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 908.989115] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 909.008473] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 909.009265] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 909.009265] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 909.009265] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-284" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.009690] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-c414a373-6c11-4d9f-9df4-ebde384531f2 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.010036] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-c414a373-6c11-4d9f-9df4-ebde384531f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.010115] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-c414a373-6c11-4d9f-9df4-ebde384531f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.013756] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-c414a373-6c11-4d9f-9df4-ebde384531f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.013972] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c414a373-6c11-4d9f-9df4-ebde384531f2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.055576] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.056933] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.057067] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.057331] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.057428] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.057640] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.057753] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.057824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.057974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.058062] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.058166] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 already deleted. [ 909.058238] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.092082] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.156597] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 in Status: SUCCESS [ 909.156833] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.320117] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf in Status: SUCCESS [ 909.324018] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf deletion is rescheduled due to dependency. [ 909.324018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.520491] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.520491] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.520491] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.520491] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.520491] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.520491] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port c414a373-6c11-4d9f-9df4-ebde384531f2 not found, creating... [ 909.520491] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.520491] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.520491] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.520491] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.520491] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.520919] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.520919] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.520919] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.520919] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.521740] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.522081] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: c414a373-6c11-4d9f-9df4-ebde384531f2 is going to be created. [ 909.544114] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.544114] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.544114] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.544114] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.544114] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.544114] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-c414a373-6c11-4d9f-9df4-ebde384531f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.597467] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.597467] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.597467] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.597467] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.597467] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.597467] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf is going to be updated. [ 909.633541] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.633541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.633541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.633541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.633541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.642502] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf in Status: IN_PROGRESS for 2s [ 910.321736] env[69559]: INFO networking_nsxv3.common.synchronization [req-418ca192-959a-4b00-acc1-4cc73cc277cc req-0a48db91-1fa6-42b5-8713-233ddd8cfd06 service nova] Enqueued Resource ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 with Priority: HIGHEST for action security_group_rules [ 910.321957] env[69559]: INFO networking_nsxv3.common.synchronization [req-418ca192-959a-4b00-acc1-4cc73cc277cc req-0a48db91-1fa6-42b5-8713-233ddd8cfd06 service nova] Enqueued Resource ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 with Priority: HIGHEST for action security_group_members [ 910.322240] env[69559]: INFO networking_nsxv3.common.synchronization [req-418ca192-959a-4b00-acc1-4cc73cc277cc req-0a48db91-1fa6-42b5-8713-233ddd8cfd06 service nova] Enqueued Resource ID: c414a373-6c11-4d9f-9df4-ebde384531f2 with Priority: HIGHEST for action port [ 910.322517] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 with Priority: HIGHEST for action security_group_rules [ 910.322649] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 with Priority: HIGHEST for action security_group_members [ 910.324886] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c414a373-6c11-4d9f-9df4-ebde384531f2 with Priority: HIGHEST for action port [ 910.324886] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.324886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.324886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.324886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.324886] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.324886] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.325285] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.325285] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.325285] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.325406] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.325406] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.325508] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.325601] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.325792] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.325792] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.326869] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-c414a373-6c11-4d9f-9df4-ebde384531f2 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.326980] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c414a373-6c11-4d9f-9df4-ebde384531f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.327068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c414a373-6c11-4d9f-9df4-ebde384531f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.327226] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c414a373-6c11-4d9f-9df4-ebde384531f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.327298] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c414a373-6c11-4d9f-9df4-ebde384531f2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.700566] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf in Status: SUCCESS [ 910.700566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.702196] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.702196] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.702196] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.830579] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.831812] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.832056] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.832284] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c414a373-6c11-4d9f-9df4-ebde384531f2 with status ACTIVE [ 910.832652] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.832868] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.833016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.833352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.833520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.833815] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.833977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.834093] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.834342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.834469] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.834736] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.834883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.834984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.835288] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.835356] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.835447] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c414a373-6c11-4d9f-9df4-ebde384531f2 is going to be updated. [ 910.855952] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.856112] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.856156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.856422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.856626] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.856850] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c414a373-6c11-4d9f-9df4-ebde384531f2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.203887] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.203887] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.341490] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.579411] env[69559]: INFO networking_nsxv3.common.synchronization [req-839c503e-cc6d-4b54-ab2c-747da21eefc9 req-3540e225-b277-451c-9503-10ca0ec9ac31 tempest-ServersTestJSON-1384568919 tempest-ServersTestJSON-1384568919-project-member] Enqueued Resource ID: 99092389-59da-4e36-9a78-d2e1e7edec3e with Priority: HIGHEST for action security_group_members [ 911.579886] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99092389-59da-4e36-9a78-d2e1e7edec3e with Priority: HIGHEST for action security_group_members [ 911.580176] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-99092389-59da-4e36-9a78-d2e1e7edec3e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.580306] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.580375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.580764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.580873] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.580982] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.580982] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.581153] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.581279] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.581324] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99092389-59da-4e36-9a78-d2e1e7edec3e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.654030] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf in Status: SUCCESS [ 911.654030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.654030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.654030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.654030] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.654030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.654030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.655898] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.655898] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.655898] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.846035] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.846035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.846035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.846035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.846035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.846035] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 is going to be created. [ 911.867347] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.868445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.868445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.870565] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.870565] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.881017] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 in Status: UNINITIALIZED for 2s [ 912.011142] env[69559]: INFO networking_nsxv3.common.synchronization [req-5b8287f8-ae18-4e73-a38e-5611ead8a3b5 req-56a65be9-6fd1-4bee-ad0e-c001de1b21e9 tempest-DeleteServersTestJSON-1423597435 tempest-DeleteServersTestJSON-1423597435-project-member] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 912.011142] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 912.011142] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.011142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.011142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.011142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.011648] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.011885] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.012147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.012407] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.012583] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.012756] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.087888] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.087888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.087888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.087888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.087888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.087888] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.087888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.087888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.087888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.087888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.087888] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99092389-59da-4e36-9a78-d2e1e7edec3e is going to be updated. [ 912.112375] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.112375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.112375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.112375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.112375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.122643] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99092389-59da-4e36-9a78-d2e1e7edec3e in Status: IN_PROGRESS for 2s [ 912.159697] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.391964] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-596 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.391964] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.391964] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.391964] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.391964] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.391964] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.391964] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.391964] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.391964] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.392502] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 912.392502] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 912.392502] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 912.392502] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 912.392502] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 912.392645] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 912.392979] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 912.417353] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 912.417353] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 912.417353] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 912.417353] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.417476] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-142f49a2-e6ec-4d0a-b49a-df35192f8797 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.417759] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-142f49a2-e6ec-4d0a-b49a-df35192f8797" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.417759] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-142f49a2-e6ec-4d0a-b49a-df35192f8797" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.418293] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-142f49a2-e6ec-4d0a-b49a-df35192f8797" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.418293] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('142f49a2-e6ec-4d0a-b49a-df35192f8797',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.515657] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.515657] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.515657] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.517934] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.517934] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.517934] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.518888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.518888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.518888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.518888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.518888] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be updated. [ 912.543448] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.543600] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.543671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.543845] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.543978] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.551682] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 912.658547] env[69559]: INFO networking_nsxv3.common.synchronization [None req-d10fbe8f-dad4-48f1-a527-bd0b650037de None None] Enqueued Resource ID: c9605384-6e08-419f-973d-f961ad1edb34 with Priority: HIGHEST for action port [ 912.658895] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9605384-6e08-419f-973d-f961ad1edb34 with Priority: HIGHEST for action port [ 912.660836] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9605384-6e08-419f-973d-f961ad1edb34 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.660836] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9605384-6e08-419f-973d-f961ad1edb34" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.660836] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9605384-6e08-419f-973d-f961ad1edb34" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.664066] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9605384-6e08-419f-973d-f961ad1edb34" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.664066] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9605384-6e08-419f-973d-f961ad1edb34',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.664656] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.920510] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.920758] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.920895] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.921213] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.921367] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.921695] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 142f49a2-e6ec-4d0a-b49a-df35192f8797 not found, creating... [ 912.921794] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.921980] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.922111] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.922342] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.922494] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.922820] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.922947] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.924765] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.924765] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.924765] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.924765] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 142f49a2-e6ec-4d0a-b49a-df35192f8797 is going to be created. [ 912.958022] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.958022] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.958022] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.958022] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.958022] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.958022] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-142f49a2-e6ec-4d0a-b49a-df35192f8797" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.166517] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9605384-6e08-419f-973d-f961ad1edb34 [ 913.166517] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.166517] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.166517] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.166517] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.166517] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.166801] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9605384-6e08-419f-973d-f961ad1edb34 already deleted. [ 913.166801] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9605384-6e08-419f-973d-f961ad1edb34" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.167041] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.167144] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.167210] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.167630] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.167630] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.167630] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf is going to be updated. [ 913.200317] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.203697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.203697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.203697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.203697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.215059] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf in Status: IN_PROGRESS for 2s [ 913.857212] env[69559]: INFO networking_nsxv3.common.synchronization [req-5b8287f8-ae18-4e73-a38e-5611ead8a3b5 req-09e53267-6eef-4f4d-bd0a-59601363fd59 service nova] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_rules [ 913.857484] env[69559]: INFO networking_nsxv3.common.synchronization [req-5b8287f8-ae18-4e73-a38e-5611ead8a3b5 req-09e53267-6eef-4f4d-bd0a-59601363fd59 service nova] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 913.857626] env[69559]: INFO networking_nsxv3.common.synchronization [req-5b8287f8-ae18-4e73-a38e-5611ead8a3b5 req-09e53267-6eef-4f4d-bd0a-59601363fd59 service nova] Enqueued Resource ID: 142f49a2-e6ec-4d0a-b49a-df35192f8797 with Priority: HIGHEST for action port [ 913.858835] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_rules [ 913.859040] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 913.859177] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 142f49a2-e6ec-4d0a-b49a-df35192f8797 with Priority: HIGHEST for action port [ 913.860615] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.860767] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.860850] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.861096] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.861208] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.862148] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.862246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.863099] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-142f49a2-e6ec-4d0a-b49a-df35192f8797 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.863249] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-142f49a2-e6ec-4d0a-b49a-df35192f8797" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.863334] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-142f49a2-e6ec-4d0a-b49a-df35192f8797" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.863562] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-142f49a2-e6ec-4d0a-b49a-df35192f8797" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.864025] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('142f49a2-e6ec-4d0a-b49a-df35192f8797',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.890913] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 in Status: SUCCESS [ 913.891152] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.891307] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.891527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.891720] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.891840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.891904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.892260] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.892367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.892458] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.892545] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.134090] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99092389-59da-4e36-9a78-d2e1e7edec3e in Status: IN_PROGRESS for 4s [ 914.370530] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.370530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.370530] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 142f49a2-e6ec-4d0a-b49a-df35192f8797 with status ACTIVE [ 914.370530] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.370530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.370530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.370530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.370530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.370530] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.370530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.370530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.370530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.370530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.370530] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.371203] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.371203] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.371203] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.371203] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.371203] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 142f49a2-e6ec-4d0a-b49a-df35192f8797 is going to be updated. [ 914.394544] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.412341] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.412559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.412636] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.412865] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.413018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.414529] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-142f49a2-e6ec-4d0a-b49a-df35192f8797" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.561909] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 914.562244] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d deletion is rescheduled due to dependency. [ 914.562353] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.562514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.562734] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.565017] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.565017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.565017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.565017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.565017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.565017] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.695905] env[69559]: INFO networking_nsxv3.common.synchronization [req-da6be99a-72a3-4684-b51f-f7ec6f745ffd req-406abf84-c062-44cd-808c-6297aa3b7e78 tempest-VolumesAdminNegativeTest-1895972689 tempest-VolumesAdminNegativeTest-1895972689-project-member] Enqueued Resource ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 with Priority: HIGHEST for action security_group_members [ 914.697245] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 with Priority: HIGHEST for action security_group_members [ 914.697245] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-1feb63ae-217d-4dd9-89fc-3bc266674292 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.697675] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.697675] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.698031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.698252] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.698441] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.698536] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.698765] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.698932] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.699557] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1feb63ae-217d-4dd9-89fc-3bc266674292',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.901933] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05: rpc.has_security_group_logging(os_id): False [ 914.923263] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.923543] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.923543] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.923706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.923801] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.927091] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.927091] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.927091] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.927091] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.927091] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.927091] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 is going to be created. [ 914.985029] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.985183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.985183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.985333] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.985516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.997738] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 in Status: IN_PROGRESS for 2s [ 915.036877] env[69559]: INFO networking_nsxv3.common.synchronization [None req-a5c00086-e72d-4fa8-8b8f-191688342f5a None None] Enqueued Resource ID: 10a5a61c-0d65-4d58-96c9-c522241e96c9 with Priority: HIGHEST for action port [ 915.037535] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10a5a61c-0d65-4d58-96c9-c522241e96c9 with Priority: HIGHEST for action port [ 915.037899] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-10a5a61c-0d65-4d58-96c9-c522241e96c9 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.039520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10a5a61c-0d65-4d58-96c9-c522241e96c9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.039520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10a5a61c-0d65-4d58-96c9-c522241e96c9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.039520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10a5a61c-0d65-4d58-96c9-c522241e96c9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.039520] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10a5a61c-0d65-4d58-96c9-c522241e96c9',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.067660] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.164101] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-119 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.164344] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-119" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.164474] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-119" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.164787] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-119" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.165096] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.165259] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.165382] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.165606] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.165754] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.165963] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 915.170463] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 915.170701] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 915.171010] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 915.171236] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 915.175204] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 915.175576] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 915.202213] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.202450] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.202553] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.202835] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.202964] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.203291] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.203410] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.203502] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.203727] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.203837] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.203960] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 already deleted. [ 915.204654] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.206188] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 915.206420] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 915.206595] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 915.206805] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-119" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.207208] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-b9cdf37b-fa0f-4096-8e3e-ec4a89669970 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.207428] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-b9cdf37b-fa0f-4096-8e3e-ec4a89669970" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.207618] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-b9cdf37b-fa0f-4096-8e3e-ec4a89669970" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.207947] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-b9cdf37b-fa0f-4096-8e3e-ec4a89669970" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.208279] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9cdf37b-fa0f-4096-8e3e-ec4a89669970',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.226936] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf in Status: SUCCESS [ 915.227170] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.227328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.227536] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.227742] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.227857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.227919] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.228079] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.228160] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.228245] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.228334] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.541912] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 10a5a61c-0d65-4d58-96c9-c522241e96c9 [ 915.542209] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.542350] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.542418] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.542634] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.542741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.542813] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:10a5a61c-0d65-4d58-96c9-c522241e96c9 already deleted. [ 915.542910] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10a5a61c-0d65-4d58-96c9-c522241e96c9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.573067] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.711441] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.713226] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.713226] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.713226] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.713226] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.713226] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port b9cdf37b-fa0f-4096-8e3e-ec4a89669970 not found, creating... [ 915.713226] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.714985] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.714985] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.714985] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.714985] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.714985] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.714985] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.715329] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.715329] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.716416] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.716416] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: b9cdf37b-fa0f-4096-8e3e-ec4a89669970 is going to be created. [ 915.730692] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.732239] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.732239] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.732239] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.732239] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.732239] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.732239] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.733216] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.733216] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.733216] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.733216] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.733216] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.733216] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.733216] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.733507] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.733507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.733507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.733649] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.733748] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.733798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.733906] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.737368] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.737547] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.737723] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.737984] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.738236] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.738474] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-b9cdf37b-fa0f-4096-8e3e-ec4a89669970" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.074493] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.074777] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.074777] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.075013] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.075172] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.075223] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be updated. [ 916.101359] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.101582] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.101684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.101992] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.102263] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.109975] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 916.143845] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99092389-59da-4e36-9a78-d2e1e7edec3e in Status: SUCCESS [ 916.144638] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99092389-59da-4e36-9a78-d2e1e7edec3e deletion is rescheduled due to dependency. [ 916.144638] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.237259] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7f662d8-9904-44e6-8a35-051e2c4e15cf: rpc.has_security_group_logging(os_id): False [ 916.257054] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.257054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.257054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.257054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.257054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.257054] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.257054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.257054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.257054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.257054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.257054] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.257054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.257054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.257054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.257054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.258000] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.258000] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.258000] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.258000] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.258000] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.258000] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf is going to be updated. [ 916.318604] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.318604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.318604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.318604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.318604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.330749] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf in Status: IN_PROGRESS for 2s [ 916.439163] env[69559]: INFO networking_nsxv3.common.synchronization [req-ef692cc0-2083-4b8c-be72-64a995134497 req-fc020fa0-19e4-40b0-a904-861b72328b0f tempest-MigrationsAdminTest-370955767 tempest-MigrationsAdminTest-370955767-project-member] Enqueued Resource ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 with Priority: HIGHEST for action security_group_members [ 916.440638] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 with Priority: HIGHEST for action security_group_members [ 916.440638] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.440895] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.441151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.441495] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.443303] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.443303] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.443303] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.443303] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.443303] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.443303] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.568172] env[69559]: INFO networking_nsxv3.common.synchronization [req-da6be99a-72a3-4684-b51f-f7ec6f745ffd req-9559594a-0399-4380-b7d7-e7ce286b3b02 service nova] Enqueued Resource ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 with Priority: HIGHEST for action security_group_rules [ 916.568326] env[69559]: INFO networking_nsxv3.common.synchronization [req-da6be99a-72a3-4684-b51f-f7ec6f745ffd req-9559594a-0399-4380-b7d7-e7ce286b3b02 service nova] Enqueued Resource ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 with Priority: HIGHEST for action security_group_members [ 916.568367] env[69559]: INFO networking_nsxv3.common.synchronization [req-da6be99a-72a3-4684-b51f-f7ec6f745ffd req-9559594a-0399-4380-b7d7-e7ce286b3b02 service nova] Enqueued Resource ID: b9cdf37b-fa0f-4096-8e3e-ec4a89669970 with Priority: HIGHEST for action port [ 916.568870] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 with Priority: HIGHEST for action security_group_rules [ 916.569978] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 with Priority: HIGHEST for action security_group_members [ 916.569978] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9cdf37b-fa0f-4096-8e3e-ec4a89669970 with Priority: HIGHEST for action port [ 916.569978] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1feb63ae-217d-4dd9-89fc-3bc266674292 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.569978] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.569978] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.569978] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.570396] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1feb63ae-217d-4dd9-89fc-3bc266674292',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.570965] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-1feb63ae-217d-4dd9-89fc-3bc266674292 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.572041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.572041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.572041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.572041] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.572041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.572041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.572041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.572041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.572041] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1feb63ae-217d-4dd9-89fc-3bc266674292',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.577606] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9cdf37b-fa0f-4096-8e3e-ec4a89669970 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.577918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9cdf37b-fa0f-4096-8e3e-ec4a89669970" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.577965] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9cdf37b-fa0f-4096-8e3e-ec4a89669970" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.578213] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9cdf37b-fa0f-4096-8e3e-ec4a89669970" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.578301] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9cdf37b-fa0f-4096-8e3e-ec4a89669970',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.946563] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.008529] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 in Status: SUCCESS [ 917.008760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.081054] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-1feb63ae-217d-4dd9-89fc-3bc266674292 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.081054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.081448] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1feb63ae-217d-4dd9-89fc-3bc266674292',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.082196] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9cdf37b-fa0f-4096-8e3e-ec4a89669970 with status ACTIVE [ 917.082403] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.082515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.082571] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.082805] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.082893] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.087227] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.087332] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.087371] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.087574] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.087660] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.087860] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.087959] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.088025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.088177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.088291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.088335] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9cdf37b-fa0f-4096-8e3e-ec4a89669970 is going to be updated. [ 917.108939] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.109111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.109182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.109435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.109583] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.109775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9cdf37b-fa0f-4096-8e3e-ec4a89669970" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.453597] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.591879] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1feb63ae-217d-4dd9-89fc-3bc266674292',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.956534] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.956754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.956847] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.957142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.957261] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.957375] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 is going to be updated. [ 917.991956] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.992116] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.992189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.992430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.992590] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.006040] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 in Status: IN_PROGRESS for 2s [ 918.098930] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.099208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.099208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.099533] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.099632] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.099734] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 is going to be created. [ 918.120040] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 918.120295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.121014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.121153] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.121481] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.121481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.122440] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.122440] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.122440] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.122440] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.122440] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.128266] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.128457] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.128530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.128836] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.129088] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.139981] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 in Status: UNINITIALIZED for 2s [ 918.341499] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf in Status: SUCCESS [ 918.341792] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.342850] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.342850] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.342850] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.626284] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.626284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.626284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.626284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.626284] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.626284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.626284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.626284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.626284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.626284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.626284] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.626284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.626284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.626284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.626284] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.626284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.626856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.626856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.626856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.626856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.626856] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.845137] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.845239] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.845278] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.846524] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.846524] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.846524] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.846524] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.846524] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.846784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.846784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.846784] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.130613] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 839ae40b-5f13-4259-8e2a-b943b206557d: rpc.has_security_group_logging(os_id): False [ 919.158029] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.158029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.158029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.158029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.158029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.158029] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.158029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.158029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.158029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.158029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.158029] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.158029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.158029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.158029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.158029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.158599] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.158599] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.158599] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.158599] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.158599] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.158599] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be updated. [ 919.229694] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.229694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.229694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.229694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.229694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.238566] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 919.354557] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.354710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.354802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.355058] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.355227] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.355326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.355389] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.355537] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.355622] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.355708] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.355850] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.355940] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.356011] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.356924] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.357096] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.357218] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.360163] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.360378] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.360470] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.360564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.360658] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.863644] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7f662d8-9904-44e6-8a35-051e2c4e15cf: rpc.has_security_group_logging(os_id): False [ 919.883628] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.883761] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.883899] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.884193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.884271] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.884493] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.884573] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.884573] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.884736] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.884808] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.884984] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.885090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.885151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.885415] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.885415] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.885527] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.885616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.885675] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.885806] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.885943] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.885984] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf is going to be updated. [ 919.943607] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.943763] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.943809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.944053] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.944252] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.958052] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf in Status: IN_PROGRESS for 2s [ 920.019229] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 in Status: SUCCESS [ 920.019229] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.147485] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 in Status: UNINITIALIZED for 4s [ 920.903673] env[69559]: INFO networking_nsxv3.common.synchronization [req-8c8f12c1-629a-4598-8be5-496bbcf02635 req-e582928e-0ca5-4dac-a3d1-f25ea6d594d5 tempest-ServersAdminTestJSON-1923717545 tempest-ServersAdminTestJSON-1923717545-project-member] Enqueued Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 920.904282] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGHEST for action security_group_members [ 920.904596] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.904738] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.904807] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.905015] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.905321] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.905432] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.905512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.905695] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.905791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.905928] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.253108] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 921.253374] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.411542] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.411717] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.411786] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.412015] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.430839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.431106] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.431227] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.431286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.431477] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.431563] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.431650] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fab5e96-3f01-4c71-994f-69059ca62986 is going to be updated. [ 921.455628] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.455628] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.455628] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.455871] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.455946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.464794] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: IN_PROGRESS for 2s [ 921.971999] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf in Status: SUCCESS [ 921.971999] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.159019] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 in Status: SUCCESS [ 922.159019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.159019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.159019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.159019] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.159019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.159019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.159019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.159019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.159019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.159019] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1feb63ae-217d-4dd9-89fc-3bc266674292',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.665044] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-1feb63ae-217d-4dd9-89fc-3bc266674292 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.665044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.665044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.665044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.665448] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.665448] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.665448] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.665601] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.665601] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.665658] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.665899] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-1feb63ae-217d-4dd9-89fc-3bc266674292 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.665960] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.665992] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.667011] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.667011] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.667011] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.667011] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.667011] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.667011] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.667011] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.667011] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1feb63ae-217d-4dd9-89fc-3bc266674292',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.170256] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1feb63ae-217d-4dd9-89fc-3bc266674292: rpc.has_security_group_logging(os_id): False [ 923.190559] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.190559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.190559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.190559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.190559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.190559] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.190559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.190559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.190559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.190559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.190559] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.190559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.190559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.190559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.190559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.191629] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.191926] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.192455] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.192833] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.193048] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.194106] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 is going to be created. [ 923.268539] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.269029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.269242] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.269629] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.269963] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.280336] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 in Status: IN_PROGRESS for 2s [ 923.473365] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fab5e96-3f01-4c71-994f-69059ca62986 in Status: SUCCESS [ 923.473618] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fab5e96-3f01-4c71-994f-69059ca62986 deletion is rescheduled due to dependency. [ 923.473745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.047956] env[69559]: INFO networking_nsxv3.common.synchronization [None req-8b87997a-b570-4fe3-8b40-dc7a225d7c39 tempest-AttachVolumeNegativeTest-1400300488 tempest-AttachVolumeNegativeTest-1400300488-project-member] Enqueued Resource ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 with Priority: HIGHEST for action security_group_rules [ 925.048619] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 with Priority: HIGHEST for action security_group_rules [ 925.049218] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.049598] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.049598] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.049687] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.049881] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bb1158b-fef7-4aa2-82e3-14d38a93d9b2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.125542] env[69559]: INFO networking_nsxv3.common.synchronization [None req-124ce4c0-84c6-478f-b44c-1281e21378f8 tempest-AttachVolumeNegativeTest-1400300488 tempest-AttachVolumeNegativeTest-1400300488-project-member] Enqueued Resource ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 with Priority: HIGHEST for action security_group_rules [ 925.126076] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 with Priority: HIGHEST for action security_group_rules [ 925.126384] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.126487] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.294514] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 in Status: SUCCESS [ 925.294514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.569743] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.569933] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.570015] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.570323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.570376] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.570473] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 already deleted. [ 925.570555] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.570707] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.570955] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.570955] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bb1158b-fef7-4aa2-82e3-14d38a93d9b2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.092772] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.092772] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.092772] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.092772] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.092772] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.092772] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 already deleted. [ 926.092772] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.548905] env[69559]: INFO networking_nsxv3.common.synchronization [req-36a92a16-dbcd-45b0-8eb5-471ae952b5fd req-4672be9b-67d0-4f28-920c-dec566e18897 tempest-ServerRescueTestJSONUnderV235-7895643 tempest-ServerRescueTestJSONUnderV235-7895643-project-member] Enqueued Resource ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d with Priority: HIGHEST for action security_group_members [ 926.550039] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d with Priority: HIGHEST for action security_group_members [ 926.550039] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e9ccf2-d67a-409e-a890-78805a2caa1d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.550924] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.551104] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.551433] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.551821] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.552066] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.552243] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.552560] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.552744] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.552926] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.808053] env[69559]: INFO networking_nsxv3.common.synchronization [req-d9889255-d0f0-4e64-90a7-f13671d67254 req-c100d0f6-cbfe-43c1-939f-93fc713d143f tempest-ServersWithSpecificFlavorTestJSON-1886354194 tempest-ServersWithSpecificFlavorTestJSON-1886354194-project-member] Enqueued Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGHEST for action security_group_members [ 926.808652] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGHEST for action security_group_members [ 926.808963] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-38ad73d3-d173-4ff2-9e1d-72777311ba4d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.809259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.809259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.809580] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.809748] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.809855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.809918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.810078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.810164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.810262] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.056996] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.056996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.056996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.056996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.056996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.056996] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.056996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.056996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.056996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.056996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.056996] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d already deleted. [ 927.056996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.116472] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-765 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.116737] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-765" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.116769] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-765" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.117175] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-765" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.117452] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.117616] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.117746] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.118248] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.118441] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.118685] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 927.118809] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 927.119212] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 927.119565] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 927.119565] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 927.119727] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 927.119928] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 927.138428] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 927.138616] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 927.138745] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 927.138926] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-765" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.139274] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-a59e022e-b28e-4ab7-904f-974031423597 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.139520] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-a59e022e-b28e-4ab7-904f-974031423597" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.139648] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-a59e022e-b28e-4ab7-904f-974031423597" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.139999] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-a59e022e-b28e-4ab7-904f-974031423597" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.141563] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a59e022e-b28e-4ab7-904f-974031423597',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.316175] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.316338] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.316416] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.316705] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.316847] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.317082] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.317182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.317306] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.317409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.317485] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.317679] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d is going to be updated. [ 927.346178] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.346328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.346399] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.346626] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.346799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.355399] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d in Status: IN_PROGRESS for 2s [ 927.644833] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.647899] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.647899] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.647899] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.647899] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.647899] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port a59e022e-b28e-4ab7-904f-974031423597 not found, creating... [ 927.647899] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.647899] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.647899] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.647899] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.647899] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.648341] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.648341] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.648341] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.648341] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.648341] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.648341] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: a59e022e-b28e-4ab7-904f-974031423597 is going to be created. [ 927.668192] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.668530] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.668683] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.668956] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.669207] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.669558] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-a59e022e-b28e-4ab7-904f-974031423597" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.006191] env[69559]: INFO networking_nsxv3.common.synchronization [req-95ef1a6d-e3e9-4a73-bbdc-0bda211f6a03 req-fbcdca6d-1433-4535-84f8-a0de27374bc3 tempest-ServersTestBootFromVolume-895220158 tempest-ServersTestBootFromVolume-895220158-project-member] Enqueued Resource ID: 71804139-4bc8-4998-a537-3cd9da947efb with Priority: HIGHEST for action security_group_members [ 928.006783] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71804139-4bc8-4998-a537-3cd9da947efb with Priority: HIGHEST for action security_group_members [ 928.007111] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-71804139-4bc8-4998-a537-3cd9da947efb taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.007242] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.007292] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.007498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.007653] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.007776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.007882] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.007965] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.008062] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.008172] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71804139-4bc8-4998-a537-3cd9da947efb',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.506081] env[69559]: INFO networking_nsxv3.common.synchronization [req-36a92a16-dbcd-45b0-8eb5-471ae952b5fd req-47ced1fa-e84b-4af4-b5a5-d6d214d9adc3 service nova] Enqueued Resource ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d with Priority: HIGHEST for action security_group_rules [ 928.506081] env[69559]: INFO networking_nsxv3.common.synchronization [req-36a92a16-dbcd-45b0-8eb5-471ae952b5fd req-47ced1fa-e84b-4af4-b5a5-d6d214d9adc3 service nova] Enqueued Resource ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d with Priority: HIGHEST for action security_group_members [ 928.506081] env[69559]: INFO networking_nsxv3.common.synchronization [req-36a92a16-dbcd-45b0-8eb5-471ae952b5fd req-47ced1fa-e84b-4af4-b5a5-d6d214d9adc3 service nova] Enqueued Resource ID: a59e022e-b28e-4ab7-904f-974031423597 with Priority: HIGHEST for action port [ 928.506081] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d with Priority: HIGHEST for action security_group_rules [ 928.506081] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d with Priority: HIGHEST for action security_group_members [ 928.506622] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a59e022e-b28e-4ab7-904f-974031423597 with Priority: HIGHEST for action port [ 928.506622] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6e9ccf2-d67a-409e-a890-78805a2caa1d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.506748] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.506841] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.508020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.508020] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.512023] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e9ccf2-d67a-409e-a890-78805a2caa1d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.512023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.512023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.512023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.512023] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.512023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.512023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.512023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.512023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.512023] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.512023] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-a59e022e-b28e-4ab7-904f-974031423597 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.512023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a59e022e-b28e-4ab7-904f-974031423597" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.512023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a59e022e-b28e-4ab7-904f-974031423597" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.512023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a59e022e-b28e-4ab7-904f-974031423597" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.512023] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a59e022e-b28e-4ab7-904f-974031423597',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.512755] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.512755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.512755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.513930] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.535526] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.535526] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.535526] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.535526] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.535526] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.535526] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.535526] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71804139-4bc8-4998-a537-3cd9da947efb is going to be updated. [ 928.562084] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.562293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.562293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.562507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.562646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.570309] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71804139-4bc8-4998-a537-3cd9da947efb in Status: IN_PROGRESS for 2s [ 929.012699] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e9ccf2-d67a-409e-a890-78805a2caa1d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.012874] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.015153] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a59e022e-b28e-4ab7-904f-974031423597 with status ACTIVE [ 929.015338] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.015452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.015515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.015756] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.015846] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.016029] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.016128] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.016193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.016368] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.016404] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.016578] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.016679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.016735] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.016875] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.016949] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.017044] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a59e022e-b28e-4ab7-904f-974031423597 is going to be updated. [ 929.018100] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.038230] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.038405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.038456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.039173] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.039447] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.039521] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a59e022e-b28e-4ab7-904f-974031423597" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.378692] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d in Status: SUCCESS [ 929.378886] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d deletion is rescheduled due to dependency. [ 929.379013] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.522198] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.024098] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.024337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.024455] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.024901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.025053] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.025221] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d is going to be created. [ 930.050356] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.050545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.050633] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.050848] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.051610] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.062191] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d in Status: UNINITIALIZED for 2s [ 930.579015] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71804139-4bc8-4998-a537-3cd9da947efb in Status: SUCCESS [ 930.579397] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71804139-4bc8-4998-a537-3cd9da947efb deletion is rescheduled due to dependency. [ 930.579550] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71804139-4bc8-4998-a537-3cd9da947efb" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.883170] env[69559]: INFO networking_nsxv3.common.synchronization [req-ce55e116-aaac-4806-b2a1-02689eea5d67 req-cd04e96c-c9da-4d39-98a8-00bfbf069ac5 tempest-VolumesAdminNegativeTest-1895972689 tempest-VolumesAdminNegativeTest-1895972689-project-member] Enqueued Resource ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 with Priority: HIGHEST for action security_group_members [ 930.883713] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 with Priority: HIGHEST for action security_group_members [ 930.884580] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-1feb63ae-217d-4dd9-89fc-3bc266674292 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.884745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.884810] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.885030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.885194] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.885307] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.885368] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.885511] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.885598] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.885689] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1feb63ae-217d-4dd9-89fc-3bc266674292',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.388573] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.388825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.388825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.389024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.389118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.389324] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.389500] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.389563] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.389695] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.389787] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.391156] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 is going to be updated. [ 931.416590] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.416785] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.416884] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.417076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.417219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.426154] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 in Status: IN_PROGRESS for 2s [ 932.070193] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d in Status: SUCCESS [ 932.070439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.070643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.070835] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.071045] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.071336] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.071336] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.071502] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.071502] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.071597] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.071597] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.572735] env[69559]: INFO networking_nsxv3.common.synchronization [req-3e997038-5367-4ab9-9b12-4b11a1c3e663 req-8cf65ab5-155e-4fd9-b1bf-a2adf71574fc tempest-ServersV294TestFqdnHostnames-516618000 tempest-ServersV294TestFqdnHostnames-516618000-project-member] Enqueued Resource ID: 67da4308-465f-4939-8941-41bacf52a39e with Priority: HIGHEST for action security_group_members [ 932.573242] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67da4308-465f-4939-8941-41bacf52a39e with Priority: HIGHEST for action security_group_members [ 932.573578] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e9ccf2-d67a-409e-a890-78805a2caa1d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.573706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.573775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.573968] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.574465] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.574634] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.574747] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.574992] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.575136] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.577428] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.577663] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e9ccf2-d67a-409e-a890-78805a2caa1d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.577782] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.577954] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.579200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.579200] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.579200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.579200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.579200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.579200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.579200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.579200] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.579617] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-67da4308-465f-4939-8941-41bacf52a39e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.580455] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.580455] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.580455] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.580455] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.580655] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.580655] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.580714] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.580784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.580877] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67da4308-465f-4939-8941-41bacf52a39e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.020189] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-571 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.020469] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-571" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.020669] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-571" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.021195] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-571" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.021717] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.022070] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.022311] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.022683] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.022917] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.023268] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 933.023483] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 933.023651] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 933.023812] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 933.023978] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 933.024177] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 933.024412] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 933.043896] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 933.044135] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 933.044330] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 933.044570] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-571" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.044987] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-f8761d8f-ce45-4f47-afa4-e2f6076eb405 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.045233] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-f8761d8f-ce45-4f47-afa4-e2f6076eb405" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.045403] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-f8761d8f-ce45-4f47-afa4-e2f6076eb405" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.045843] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-f8761d8f-ce45-4f47-afa4-e2f6076eb405" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.046060] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8761d8f-ce45-4f47-afa4-e2f6076eb405',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.086480] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6e9ccf2-d67a-409e-a890-78805a2caa1d: rpc.has_security_group_logging(os_id): False [ 933.089419] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.089419] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.089419] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.089625] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.089730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.089866] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.090577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.090577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.090577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.090577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.090577] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67da4308-465f-4939-8941-41bacf52a39e already deleted. [ 933.090577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.106678] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.106824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.106881] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.107183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.107281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.107466] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.107577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.107631] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.107782] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.107849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.108190] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.108190] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.108190] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.108421] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.108421] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.108552] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.108659] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.108732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.108839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.108917] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.108994] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d is going to be created. [ 933.163410] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.163616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.163616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.163839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.164038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.174088] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d in Status: IN_PROGRESS for 2s [ 933.441026] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 in Status: SUCCESS [ 933.441254] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 deletion is rescheduled due to dependency. [ 933.441382] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.548972] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.549278] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.549474] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.549776] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.549933] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.550108] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port f8761d8f-ce45-4f47-afa4-e2f6076eb405 not found, creating... [ 933.550394] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.550616] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.550772] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.551009] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.551162] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.551453] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.551617] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.551740] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.551951] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.552106] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.552263] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: f8761d8f-ce45-4f47-afa4-e2f6076eb405 is going to be created. [ 933.572200] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.572427] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.572549] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.572823] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.573071] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.573301] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-f8761d8f-ce45-4f47-afa4-e2f6076eb405" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.956108] env[69559]: INFO networking_nsxv3.common.synchronization [req-19e1bd7b-3b22-4965-9bc5-320ced437c80 req-eb2cc91c-af70-4bb1-bc95-29d02f925c56 tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 933.956711] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 933.957177] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.957283] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.957283] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.957634] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.957819] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.957961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.958054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.958247] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.958344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.958440] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.218929] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.219327] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.219327] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.219640] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.219968] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.220396] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.220640] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.221638] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.223256] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.223518] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 934.223652] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 934.223789] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 934.223910] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 934.224053] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 934.224172] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 934.224315] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 934.248777] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 934.248777] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 934.248777] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 934.248777] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.248777] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-089281da-ac28-43e3-9284-18f73efdf735 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.248777] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-089281da-ac28-43e3-9284-18f73efdf735" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.248777] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-089281da-ac28-43e3-9284-18f73efdf735" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.248777] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-089281da-ac28-43e3-9284-18f73efdf735" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.248777] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('089281da-ac28-43e3-9284-18f73efdf735',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.258730] env[69559]: INFO networking_nsxv3.common.synchronization [req-3e997038-5367-4ab9-9b12-4b11a1c3e663 req-8671f8b1-d93d-4d02-99fb-c392dc0d40d0 service nova] Enqueued Resource ID: 67da4308-465f-4939-8941-41bacf52a39e with Priority: HIGHEST for action security_group_rules [ 934.258937] env[69559]: INFO networking_nsxv3.common.synchronization [req-3e997038-5367-4ab9-9b12-4b11a1c3e663 req-8671f8b1-d93d-4d02-99fb-c392dc0d40d0 service nova] Enqueued Resource ID: 67da4308-465f-4939-8941-41bacf52a39e with Priority: HIGHEST for action security_group_members [ 934.259111] env[69559]: INFO networking_nsxv3.common.synchronization [req-3e997038-5367-4ab9-9b12-4b11a1c3e663 req-8671f8b1-d93d-4d02-99fb-c392dc0d40d0 service nova] Enqueued Resource ID: f8761d8f-ce45-4f47-afa4-e2f6076eb405 with Priority: HIGHEST for action port [ 934.259477] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67da4308-465f-4939-8941-41bacf52a39e with Priority: HIGHEST for action security_group_rules [ 934.259548] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67da4308-465f-4939-8941-41bacf52a39e with Priority: HIGHEST for action security_group_members [ 934.259659] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8761d8f-ce45-4f47-afa4-e2f6076eb405 with Priority: HIGHEST for action port [ 934.262783] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67da4308-465f-4939-8941-41bacf52a39e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.262949] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.263033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.263409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.263409] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67da4308-465f-4939-8941-41bacf52a39e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.264923] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-67da4308-465f-4939-8941-41bacf52a39e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.264923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.264923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.264923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.264923] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.264923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.264923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.264923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.265271] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.265271] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67da4308-465f-4939-8941-41bacf52a39e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.265806] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8761d8f-ce45-4f47-afa4-e2f6076eb405 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.265927] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8761d8f-ce45-4f47-afa4-e2f6076eb405" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.265982] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8761d8f-ce45-4f47-afa4-e2f6076eb405" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.266354] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8761d8f-ce45-4f47-afa4-e2f6076eb405" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.266354] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8761d8f-ce45-4f47-afa4-e2f6076eb405',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.460377] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.460576] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.460650] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.460858] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.460948] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.461161] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.461261] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.461322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.461469] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.461571] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.461660] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19282542-923d-4b29-8ce7-e30953449122 already deleted. [ 934.462442] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.754137] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.754137] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.754137] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.754137] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.754137] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.754137] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 089281da-ac28-43e3-9284-18f73efdf735 not found, creating... [ 934.754137] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.754137] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.754137] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.754137] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.754137] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.754495] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.754495] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.754495] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.754703] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.755122] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.755398] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 089281da-ac28-43e3-9284-18f73efdf735 is going to be created. [ 934.771091] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-67da4308-465f-4939-8941-41bacf52a39e taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.771091] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.771091] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('67da4308-465f-4939-8941-41bacf52a39e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.771091] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8761d8f-ce45-4f47-afa4-e2f6076eb405 with status ACTIVE [ 934.771091] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.771091] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.771091] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.771091] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.771091] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.771091] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.772212] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.772866] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.773222] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.775760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.775760] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.775760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.775760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.775760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.775760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.775760] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8761d8f-ce45-4f47-afa4-e2f6076eb405 is going to be updated. [ 934.778209] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.778209] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.778209] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.778209] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.778209] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.778462] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-089281da-ac28-43e3-9284-18f73efdf735" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.798030] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.798030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.798222] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.798437] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.798564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.798800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8761d8f-ce45-4f47-afa4-e2f6076eb405" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.186694] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d in Status: SUCCESS [ 935.186994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.280651] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('67da4308-465f-4939-8941-41bacf52a39e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.488271] env[69559]: INFO networking_nsxv3.common.synchronization [req-19e1bd7b-3b22-4965-9bc5-320ced437c80 req-379ec264-acca-4243-8068-275218a68359 service nova] Enqueued Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_rules [ 935.488571] env[69559]: INFO networking_nsxv3.common.synchronization [req-19e1bd7b-3b22-4965-9bc5-320ced437c80 req-379ec264-acca-4243-8068-275218a68359 service nova] Enqueued Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 935.489728] env[69559]: INFO networking_nsxv3.common.synchronization [req-19e1bd7b-3b22-4965-9bc5-320ced437c80 req-379ec264-acca-4243-8068-275218a68359 service nova] Enqueued Resource ID: 089281da-ac28-43e3-9284-18f73efdf735 with Priority: HIGHEST for action port [ 935.489728] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_rules [ 935.489728] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 935.489728] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 089281da-ac28-43e3-9284-18f73efdf735 with Priority: HIGHEST for action port [ 935.494016] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.494016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.494016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.494016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.494016] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.494016] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.494016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.494016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.494016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.494016] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.494016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.494016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.494016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.494016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.494016] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.495475] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-089281da-ac28-43e3-9284-18f73efdf735 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.495574] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-089281da-ac28-43e3-9284-18f73efdf735" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.495677] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-089281da-ac28-43e3-9284-18f73efdf735" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.495800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-089281da-ac28-43e3-9284-18f73efdf735" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.495876] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('089281da-ac28-43e3-9284-18f73efdf735',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.782643] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.782790] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.782790] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.782976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.783086] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.783186] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67da4308-465f-4939-8941-41bacf52a39e is going to be created. [ 935.807095] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.807292] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.807352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.807782] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.807782] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.817159] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67da4308-465f-4939-8941-41bacf52a39e in Status: UNINITIALIZED for 2s [ 935.997862] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.998037] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.998243] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.999137] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 089281da-ac28-43e3-9284-18f73efdf735 with status ACTIVE [ 936.000392] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.000392] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.000392] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.000392] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.000392] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.000392] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.000392] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.000392] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.000392] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.000392] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.002191] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.002191] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.002191] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.002191] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.002191] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.002191] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 089281da-ac28-43e3-9284-18f73efdf735 is going to be updated. [ 936.020256] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.020438] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.020515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.020763] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.020930] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.021139] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-089281da-ac28-43e3-9284-18f73efdf735" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.504025] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.007084] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.007084] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.007084] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.007084] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.007084] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.007084] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19282542-923d-4b29-8ce7-e30953449122 is going to be created. [ 937.029571] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.029810] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.029889] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.030149] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.030537] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.039847] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: UNINITIALIZED for 2s [ 937.057957] env[69559]: INFO networking_nsxv3.common.synchronization [req-01448e20-afab-4048-83f4-b0230c88261a req-9da8363f-49e1-429a-848d-f93857950d2a tempest-ServerActionsTestOtherA-1414477814 tempest-ServerActionsTestOtherA-1414477814-project-member] Enqueued Resource ID: e29c3806-d806-4df2-8a52-0ecf9da87984 with Priority: HIGHEST for action security_group_members [ 937.061081] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e29c3806-d806-4df2-8a52-0ecf9da87984 with Priority: HIGHEST for action security_group_members [ 937.061081] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e29c3806-d806-4df2-8a52-0ecf9da87984 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.061081] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.061081] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.061081] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.061081] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.061081] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.061081] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.061081] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.061081] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.061081] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e29c3806-d806-4df2-8a52-0ecf9da87984',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.341079] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-964 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.341303] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.341518] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.341736] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.342063] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.342316] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.342471] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.342669] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.342822] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.343053] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 937.343202] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 937.343308] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 937.343422] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 937.343556] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 937.343674] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 937.343832] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 937.363542] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 937.363726] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 937.363871] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 937.364140] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.364400] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-82fa5041-c117-40d6-8c23-0c7c9ee6a055 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.364592] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-82fa5041-c117-40d6-8c23-0c7c9ee6a055" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.364710] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-82fa5041-c117-40d6-8c23-0c7c9ee6a055" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.365112] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-82fa5041-c117-40d6-8c23-0c7c9ee6a055" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.365285] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82fa5041-c117-40d6-8c23-0c7c9ee6a055',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.563819] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.564146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.564146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.564388] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.564495] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.564701] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.564801] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.564934] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.565058] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.565126] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.565267] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e29c3806-d806-4df2-8a52-0ecf9da87984 already deleted. [ 937.565328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.827728] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67da4308-465f-4939-8941-41bacf52a39e in Status: SUCCESS [ 937.827728] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.827894] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.828191] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.828525] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.828588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.828625] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.828755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.828837] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.829307] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.829307] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('67da4308-465f-4939-8941-41bacf52a39e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.835690] env[69559]: INFO networking_nsxv3.common.synchronization [req-f65c5da6-6b61-4b2a-837a-6e15484d9a82 req-ac7330e1-8121-4195-aec0-a502df9dfd01 tempest-ListServerFiltersTestJSON-1483085772 tempest-ListServerFiltersTestJSON-1483085772-project-member] Enqueued Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_members [ 937.836230] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_members [ 937.836541] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.836655] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.836722] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.836915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.838103] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.838103] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.838103] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.838103] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.838103] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.838103] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.867603] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.867829] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.867962] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.868275] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.868445] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.868590] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 82fa5041-c117-40d6-8c23-0c7c9ee6a055 not found, creating... [ 937.869187] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.869368] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.869591] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.869804] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.870282] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.870282] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.870593] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.870823] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.871080] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.871319] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.871376] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 82fa5041-c117-40d6-8c23-0c7c9ee6a055 is going to be created. [ 937.900332] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.900553] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.900689] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.900993] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.901254] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.901485] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-82fa5041-c117-40d6-8c23-0c7c9ee6a055" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.334459] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('67da4308-465f-4939-8941-41bacf52a39e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.341217] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.618018] env[69559]: INFO networking_nsxv3.common.synchronization [req-01448e20-afab-4048-83f4-b0230c88261a req-09bee04e-3928-452b-a11e-a6fa5a999265 service nova] Enqueued Resource ID: e29c3806-d806-4df2-8a52-0ecf9da87984 with Priority: HIGHEST for action security_group_rules [ 938.618284] env[69559]: INFO networking_nsxv3.common.synchronization [req-01448e20-afab-4048-83f4-b0230c88261a req-09bee04e-3928-452b-a11e-a6fa5a999265 service nova] Enqueued Resource ID: e29c3806-d806-4df2-8a52-0ecf9da87984 with Priority: HIGHEST for action security_group_members [ 938.618386] env[69559]: INFO networking_nsxv3.common.synchronization [req-01448e20-afab-4048-83f4-b0230c88261a req-09bee04e-3928-452b-a11e-a6fa5a999265 service nova] Enqueued Resource ID: 82fa5041-c117-40d6-8c23-0c7c9ee6a055 with Priority: HIGHEST for action port [ 938.618632] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e29c3806-d806-4df2-8a52-0ecf9da87984 with Priority: HIGHEST for action security_group_rules [ 938.618753] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e29c3806-d806-4df2-8a52-0ecf9da87984 with Priority: HIGHEST for action security_group_members [ 938.618844] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82fa5041-c117-40d6-8c23-0c7c9ee6a055 with Priority: HIGHEST for action port [ 938.619789] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e29c3806-d806-4df2-8a52-0ecf9da87984 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.619928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.619995] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.620642] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.621315] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e29c3806-d806-4df2-8a52-0ecf9da87984',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.621568] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e29c3806-d806-4df2-8a52-0ecf9da87984 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.621697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.621847] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.622019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.622175] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.622278] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.622327] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.622905] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.623061] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.623169] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e29c3806-d806-4df2-8a52-0ecf9da87984',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.623915] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-82fa5041-c117-40d6-8c23-0c7c9ee6a055 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.624032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82fa5041-c117-40d6-8c23-0c7c9ee6a055" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.624099] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82fa5041-c117-40d6-8c23-0c7c9ee6a055" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.624259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82fa5041-c117-40d6-8c23-0c7c9ee6a055" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.624350] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82fa5041-c117-40d6-8c23-0c7c9ee6a055',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.836431] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 67da4308-465f-4939-8941-41bacf52a39e: rpc.has_security_group_logging(os_id): False [ 938.842368] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.854578] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.854740] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.854825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.855060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.855167] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.855429] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.855572] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.855663] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.855827] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.855926] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.856029] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67da4308-465f-4939-8941-41bacf52a39e is going to be created. [ 938.927830] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.928082] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.928177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.928478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.928815] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.948195] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67da4308-465f-4939-8941-41bacf52a39e in Status: IN_PROGRESS for 2s [ 939.053987] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: SUCCESS [ 939.054259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.054441] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.054815] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.055042] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.055169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.055238] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.055397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.055490] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.055579] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.055683] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.127779] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e29c3806-d806-4df2-8a52-0ecf9da87984',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.127779] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e29c3806-d806-4df2-8a52-0ecf9da87984 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.127779] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.127779] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82fa5041-c117-40d6-8c23-0c7c9ee6a055 with status ACTIVE [ 939.128162] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.128162] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.128162] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.128271] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.128271] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.128456] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.128567] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.128624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.128774] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.128854] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.130024] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.130024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.130024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.130024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.130024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.130024] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82fa5041-c117-40d6-8c23-0c7c9ee6a055 is going to be updated. [ 939.153518] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.153666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.153727] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.153925] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.156035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.156035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82fa5041-c117-40d6-8c23-0c7c9ee6a055" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.345284] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.345463] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.345533] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.345758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.345854] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.345998] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf is going to be updated. [ 939.381612] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.381765] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.381838] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.382225] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.382225] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.402625] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf in Status: IN_PROGRESS for 2s [ 939.557736] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.557965] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.558053] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.558291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.558469] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.558585] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.558628] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.558824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.558918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.559015] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.559234] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.559342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.559460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.559641] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.559791] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.559887] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.559949] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.560131] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.560212] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.560533] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.560533] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.633239] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e29c3806-d806-4df2-8a52-0ecf9da87984',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.063634] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19282542-923d-4b29-8ce7-e30953449122: rpc.has_security_group_logging(os_id): False [ 940.081853] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.082014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.082076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.082274] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.082369] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.082559] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.082780] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.082780] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.082881] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.082939] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.083137] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.083234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.083293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.083426] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.083501] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.083688] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.083781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.083830] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.083966] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.084051] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.084397] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19282542-923d-4b29-8ce7-e30953449122 is going to be created. [ 940.135588] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.135760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.135836] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.136083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.136204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.136315] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e29c3806-d806-4df2-8a52-0ecf9da87984 is going to be created. [ 940.138701] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.138701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.138701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.138701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.138903] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.153212] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: IN_PROGRESS for 2s [ 940.163640] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.163640] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.163640] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.163640] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.163640] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.171699] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e29c3806-d806-4df2-8a52-0ecf9da87984 in Status: UNINITIALIZED for 2s [ 940.965660] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67da4308-465f-4939-8941-41bacf52a39e in Status: SUCCESS [ 940.966013] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.415054] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf in Status: SUCCESS [ 941.415054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.866341] env[69559]: INFO networking_nsxv3.common.synchronization [req-b3c66903-7894-4656-b1e5-6fffcae8f0a2 req-2e10cdf7-fbf5-4ba3-9d34-eb3a4a07535e tempest-ImagesTestJSON-1150485476 tempest-ImagesTestJSON-1150485476-project-member] Enqueued Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 941.866940] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 941.869096] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.869096] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.869096] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.869096] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.869096] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.869096] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.869096] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.870485] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.872216] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.872360] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.167082] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: SUCCESS [ 942.167370] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.182022] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e29c3806-d806-4df2-8a52-0ecf9da87984 in Status: SUCCESS [ 942.182022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.182022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.182555] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.182633] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.182836] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.182936] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.183244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.183376] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.183657] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.183805] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e29c3806-d806-4df2-8a52-0ecf9da87984',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.255999] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-190 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.256244] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-190" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.256378] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-190" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.256672] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-190" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.256937] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.257121] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.257305] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.257856] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.258038] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.258281] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 942.258395] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 942.258518] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 942.258634] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 942.258748] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 942.260959] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 942.260959] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 942.279477] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 942.279761] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 942.279961] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 942.280191] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-190" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.280665] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-1fe5fea7-7c0c-474e-a03f-7c783685c7bf taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.280882] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-1fe5fea7-7c0c-474e-a03f-7c783685c7bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.281128] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-1fe5fea7-7c0c-474e-a03f-7c783685c7bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.281465] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-1fe5fea7-7c0c-474e-a03f-7c783685c7bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.281648] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fe5fea7-7c0c-474e-a03f-7c783685c7bf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.374783] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.687592] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e29c3806-d806-4df2-8a52-0ecf9da87984 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.687754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.687832] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.688065] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.688231] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.688334] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.688392] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.688543] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.688632] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.688717] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.688858] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e29c3806-d806-4df2-8a52-0ecf9da87984 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.688946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.689010] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.689164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.689301] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.689749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.689749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.689749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.689749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.689749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.690057] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e29c3806-d806-4df2-8a52-0ecf9da87984',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.783696] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.783946] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.784099] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.784385] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.784546] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.784705] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 1fe5fea7-7c0c-474e-a03f-7c783685c7bf not found, creating... [ 942.784977] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.785162] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.785286] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.785605] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.785769] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.786606] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.786606] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.786606] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.786606] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.786816] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.786886] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 1fe5fea7-7c0c-474e-a03f-7c783685c7bf is going to be created. [ 942.809765] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.809981] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.810139] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.810414] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.810685] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.810935] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-1fe5fea7-7c0c-474e-a03f-7c783685c7bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.880851] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.193235] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e29c3806-d806-4df2-8a52-0ecf9da87984: rpc.has_security_group_logging(os_id): False [ 943.220267] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.220454] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.220454] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.220748] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.220856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.221118] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.221224] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.221297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.221451] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.221545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.221765] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.221870] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.221930] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.222100] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.222187] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.222388] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.222484] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.222546] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.222685] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.222758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.222862] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e29c3806-d806-4df2-8a52-0ecf9da87984 is going to be created. [ 943.291128] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.291566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.291566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.291566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.291723] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.302562] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e29c3806-d806-4df2-8a52-0ecf9da87984 in Status: IN_PROGRESS for 2s [ 943.384019] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.385025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.385025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.385025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.385025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.385025] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 is going to be updated. [ 943.422338] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.422508] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.422803] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.422803] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.422925] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.436276] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: IN_PROGRESS for 2s [ 943.721445] env[69559]: INFO networking_nsxv3.common.synchronization [req-b3c66903-7894-4656-b1e5-6fffcae8f0a2 req-e50769aa-70cd-4763-b899-70901af9b026 service nova] Enqueued Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_rules [ 943.722638] env[69559]: INFO networking_nsxv3.common.synchronization [req-b3c66903-7894-4656-b1e5-6fffcae8f0a2 req-e50769aa-70cd-4763-b899-70901af9b026 service nova] Enqueued Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 943.723158] env[69559]: INFO networking_nsxv3.common.synchronization [req-b3c66903-7894-4656-b1e5-6fffcae8f0a2 req-e50769aa-70cd-4763-b899-70901af9b026 service nova] Enqueued Resource ID: 1fe5fea7-7c0c-474e-a03f-7c783685c7bf with Priority: HIGHEST for action port [ 943.723817] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_rules [ 943.723989] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 943.724439] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fe5fea7-7c0c-474e-a03f-7c783685c7bf with Priority: HIGHEST for action port [ 943.724439] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.724558] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.724893] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.724893] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.724893] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.729022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.729022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.729022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fe5fea7-7c0c-474e-a03f-7c783685c7bf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.729022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fe5fea7-7c0c-474e-a03f-7c783685c7bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.729022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fe5fea7-7c0c-474e-a03f-7c783685c7bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.729022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fe5fea7-7c0c-474e-a03f-7c783685c7bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.729022] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fe5fea7-7c0c-474e-a03f-7c783685c7bf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.182900] env[69559]: INFO networking_nsxv3.common.synchronization [None req-ae1823a8-67ab-4eac-9920-4f7770125c85 None None] Enqueued Resource ID: 7974717f-cbb6-415c-bf9e-099207fd7c34 with Priority: HIGHEST for action port [ 944.182900] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7974717f-cbb6-415c-bf9e-099207fd7c34 with Priority: HIGHEST for action port [ 944.183260] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-7974717f-cbb6-415c-bf9e-099207fd7c34 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.183381] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7974717f-cbb6-415c-bf9e-099207fd7c34" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.183454] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7974717f-cbb6-415c-bf9e-099207fd7c34" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.187506] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7974717f-cbb6-415c-bf9e-099207fd7c34" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.187506] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7974717f-cbb6-415c-bf9e-099207fd7c34',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.229409] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.229789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.229789] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1fe5fea7-7c0c-474e-a03f-7c783685c7bf with status ACTIVE [ 944.230166] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.230166] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.230166] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.230348] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.230442] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.230630] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.230716] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.230779] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.230950] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.231127] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.231222] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.231315] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.231374] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.231513] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.231608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.231694] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1fe5fea7-7c0c-474e-a03f-7c783685c7bf is going to be updated. [ 944.252607] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.252793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.252847] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.253077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.253239] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.253402] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fe5fea7-7c0c-474e-a03f-7c783685c7bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.689867] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7974717f-cbb6-415c-bf9e-099207fd7c34 [ 944.693025] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.693025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.693025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.693025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.693025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.693025] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7974717f-cbb6-415c-bf9e-099207fd7c34 already deleted. [ 944.693025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7974717f-cbb6-415c-bf9e-099207fd7c34" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.876218] env[69559]: INFO networking_nsxv3.common.synchronization [req-f798df03-72b4-4ff8-b7da-76386033590d req-856990b1-1162-4bb6-b079-2137150b3a16 tempest-ServersTestJSON-514909010 tempest-ServersTestJSON-514909010-project-member] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 944.876779] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 944.877087] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.877209] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.877275] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.877542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.878116] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.878181] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.878217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.878372] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.878457] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.878637] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.314943] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e29c3806-d806-4df2-8a52-0ecf9da87984 in Status: SUCCESS [ 945.315290] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.380418] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.380608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.380667] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.380889] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.380972] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.381189] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.381282] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.381356] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.381524] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.381599] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.381680] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 already deleted. [ 945.381773] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.439881] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-640 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.440155] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.440306] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.440678] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.441491] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.441679] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.441809] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.442077] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.442241] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.442453] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.442573] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.442690] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.442806] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.442923] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 945.443240] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.443481] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.453343] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: SUCCESS [ 945.453576] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.454018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.454224] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.454400] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.454737] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.454737] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.454737] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.454890] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.454890] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.461716] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.461894] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 945.462055] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.462236] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.462552] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-e288f5fb-59d8-4807-bc7a-c97f149a17b7 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.462763] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-e288f5fb-59d8-4807-bc7a-c97f149a17b7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.463060] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-e288f5fb-59d8-4807-bc7a-c97f149a17b7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.463254] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-e288f5fb-59d8-4807-bc7a-c97f149a17b7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.463537] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e288f5fb-59d8-4807-bc7a-c97f149a17b7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.728786] env[69559]: INFO networking_nsxv3.common.synchronization [None req-bdd20472-c5b0-45d0-9e3d-eb8e701d62d0 tempest-ServersTestManualDisk-1543198047 tempest-ServersTestManualDisk-1543198047-project-member] Enqueued Resource ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 with Priority: HIGHEST for action security_group_rules [ 945.728786] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 with Priority: HIGHEST for action security_group_rules [ 945.730194] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50135ff4-8447-455b-b0a1-ca85f9b5ef55 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.730655] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.730655] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.730783] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.730874] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50135ff4-8447-455b-b0a1-ca85f9b5ef55',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.872229] env[69559]: INFO networking_nsxv3.common.synchronization [None req-1a694e23-0309-4550-abae-c1eeda8ce1ca tempest-ServersTestManualDisk-1543198047 tempest-ServersTestManualDisk-1543198047-project-member] Enqueued Resource ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 with Priority: HIGHEST for action security_group_rules [ 945.872229] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 with Priority: HIGHEST for action security_group_rules [ 945.872755] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50135ff4-8447-455b-b0a1-ca85f9b5ef55 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.872755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.956696] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.970629] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.970991] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.971202] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.971575] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.971791] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.972034] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port e288f5fb-59d8-4807-bc7a-c97f149a17b7 not found, creating... [ 945.972454] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.972802] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.972966] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.973269] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.974648] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.974648] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.974648] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.974648] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.974648] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.974898] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.975044] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: e288f5fb-59d8-4807-bc7a-c97f149a17b7 is going to be created. [ 945.996062] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.996328] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.996576] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.996987] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.997381] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.998102] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-e288f5fb-59d8-4807-bc7a-c97f149a17b7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.254022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.254022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.254022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.254022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.254022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.254022] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 already deleted. [ 946.254022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.254022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.254022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.254022] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50135ff4-8447-455b-b0a1-ca85f9b5ef55',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.459028] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.698483] env[69559]: INFO networking_nsxv3.common.synchronization [None req-ad258de5-a13b-4f56-8547-88cfe4a09f08 None None] Enqueued Resource ID: 8611346b-35fc-4b90-b35a-3759b5b9eec3 with Priority: HIGHEST for action port [ 946.698483] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8611346b-35fc-4b90-b35a-3759b5b9eec3 with Priority: HIGHEST for action port [ 946.698483] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-8611346b-35fc-4b90-b35a-3759b5b9eec3 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.698664] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8611346b-35fc-4b90-b35a-3759b5b9eec3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.698664] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8611346b-35fc-4b90-b35a-3759b5b9eec3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.699539] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8611346b-35fc-4b90-b35a-3759b5b9eec3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.699539] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8611346b-35fc-4b90-b35a-3759b5b9eec3',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.772676] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.772865] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.772965] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.773257] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.773376] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.773507] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 already deleted. [ 946.773624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.962893] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.963054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.963375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.963375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.963488] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.963488] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 is going to be updated. [ 946.990864] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.992679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.992679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.992679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.992679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.999709] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: IN_PROGRESS for 2s [ 947.203612] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8611346b-35fc-4b90-b35a-3759b5b9eec3 [ 947.203612] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.203612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.203612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.203612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.203612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.203612] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8611346b-35fc-4b90-b35a-3759b5b9eec3 already deleted. [ 947.203612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8611346b-35fc-4b90-b35a-3759b5b9eec3" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.301914] env[69559]: INFO networking_nsxv3.common.synchronization [req-f798df03-72b4-4ff8-b7da-76386033590d req-927842b7-009a-470f-bbff-1f87ff2cda5f service nova] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_rules [ 947.302270] env[69559]: INFO networking_nsxv3.common.synchronization [req-f798df03-72b4-4ff8-b7da-76386033590d req-927842b7-009a-470f-bbff-1f87ff2cda5f service nova] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 947.302441] env[69559]: INFO networking_nsxv3.common.synchronization [req-f798df03-72b4-4ff8-b7da-76386033590d req-927842b7-009a-470f-bbff-1f87ff2cda5f service nova] Enqueued Resource ID: e288f5fb-59d8-4807-bc7a-c97f149a17b7 with Priority: HIGHEST for action port [ 947.302769] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_rules [ 947.302945] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 947.303094] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e288f5fb-59d8-4807-bc7a-c97f149a17b7 with Priority: HIGHEST for action port [ 947.303712] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.303927] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.304049] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.304369] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.304498] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.305376] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.305770] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.305770] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.305770] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.305887] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.307022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.307022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.307022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.307022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.307022] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.311568] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-e288f5fb-59d8-4807-bc7a-c97f149a17b7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.311568] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e288f5fb-59d8-4807-bc7a-c97f149a17b7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.311568] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e288f5fb-59d8-4807-bc7a-c97f149a17b7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.311568] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e288f5fb-59d8-4807-bc7a-c97f149a17b7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.311568] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e288f5fb-59d8-4807-bc7a-c97f149a17b7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.687726] env[69559]: INFO networking_nsxv3.common.synchronization [req-d3eff1ef-2761-4c6e-a652-b3033795923a req-e8acf7c2-4723-4a89-a767-71f8e8c3ce41 tempest-ServerRescueTestJSONUnderV235-7895643 tempest-ServerRescueTestJSONUnderV235-7895643-project-member] Enqueued Resource ID: c1260795-50e7-439f-ba84-2ce328b42bf0 with Priority: HIGHEST for action security_group_members [ 947.688042] env[69559]: INFO networking_nsxv3.common.synchronization [req-d3eff1ef-2761-4c6e-a652-b3033795923a req-e8acf7c2-4723-4a89-a767-71f8e8c3ce41 tempest-ServerRescueTestJSONUnderV235-7895643 tempest-ServerRescueTestJSONUnderV235-7895643-project-member] Enqueued Resource ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d with Priority: HIGHEST for action security_group_members [ 947.689482] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1260795-50e7-439f-ba84-2ce328b42bf0 with Priority: HIGHEST for action security_group_members [ 947.689482] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d with Priority: HIGHEST for action security_group_members [ 947.689482] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1260795-50e7-439f-ba84-2ce328b42bf0 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.690693] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1260795-50e7-439f-ba84-2ce328b42bf0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.690743] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1260795-50e7-439f-ba84-2ce328b42bf0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.693277] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1260795-50e7-439f-ba84-2ce328b42bf0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.693277] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.693277] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.693277] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.693277] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.693277] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.693277] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1260795-50e7-439f-ba84-2ce328b42bf0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.694535] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e9ccf2-d67a-409e-a890-78805a2caa1d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.696384] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.696384] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.696384] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.696384] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.696384] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.698697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.698697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.698697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.698697] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.770811] env[69559]: INFO networking_nsxv3.common.synchronization [req-d3eff1ef-2761-4c6e-a652-b3033795923a req-e8acf7c2-4723-4a89-a767-71f8e8c3ce41 tempest-ServerRescueTestJSONUnderV235-7895643 tempest-ServerRescueTestJSONUnderV235-7895643-project-member] Enqueued Resource ID: c1260795-50e7-439f-ba84-2ce328b42bf0 with Priority: HIGHEST for action security_group_rules [ 947.770811] env[69559]: INFO networking_nsxv3.common.synchronization [req-d3eff1ef-2761-4c6e-a652-b3033795923a req-e8acf7c2-4723-4a89-a767-71f8e8c3ce41 tempest-ServerRescueTestJSONUnderV235-7895643 tempest-ServerRescueTestJSONUnderV235-7895643-project-member] Enqueued Resource ID: c1260795-50e7-439f-ba84-2ce328b42bf0 with Priority: HIGHEST for action security_group_members [ 947.770811] env[69559]: INFO networking_nsxv3.common.synchronization [req-d3eff1ef-2761-4c6e-a652-b3033795923a req-e8acf7c2-4723-4a89-a767-71f8e8c3ce41 tempest-ServerRescueTestJSONUnderV235-7895643 tempest-ServerRescueTestJSONUnderV235-7895643-project-member] Enqueued Resource ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d with Priority: HIGHEST for action security_group_rules [ 947.774293] env[69559]: INFO networking_nsxv3.common.synchronization [req-d3eff1ef-2761-4c6e-a652-b3033795923a req-e8acf7c2-4723-4a89-a767-71f8e8c3ce41 tempest-ServerRescueTestJSONUnderV235-7895643 tempest-ServerRescueTestJSONUnderV235-7895643-project-member] Enqueued Resource ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d with Priority: HIGHEST for action security_group_members [ 947.774293] env[69559]: INFO networking_nsxv3.common.synchronization [req-d3eff1ef-2761-4c6e-a652-b3033795923a req-e8acf7c2-4723-4a89-a767-71f8e8c3ce41 tempest-ServerRescueTestJSONUnderV235-7895643 tempest-ServerRescueTestJSONUnderV235-7895643-project-member] Enqueued Resource ID: a59e022e-b28e-4ab7-904f-974031423597 with Priority: HIGHEST for action port [ 947.774293] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1260795-50e7-439f-ba84-2ce328b42bf0 with Priority: HIGHEST for action security_group_rules [ 947.774293] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d with Priority: HIGHEST for action security_group_rules [ 947.774293] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a59e022e-b28e-4ab7-904f-974031423597 with Priority: HIGHEST for action port [ 947.774293] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1260795-50e7-439f-ba84-2ce328b42bf0 with Priority: HIGHEST for action security_group_members [ 947.774293] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d with Priority: HIGHEST for action security_group_members [ 947.774293] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1260795-50e7-439f-ba84-2ce328b42bf0 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.774293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1260795-50e7-439f-ba84-2ce328b42bf0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.774293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1260795-50e7-439f-ba84-2ce328b42bf0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.774293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1260795-50e7-439f-ba84-2ce328b42bf0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.774293] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1260795-50e7-439f-ba84-2ce328b42bf0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.783618] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6e9ccf2-d67a-409e-a890-78805a2caa1d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.783618] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.783618] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.783618] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.783618] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.783618] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-a59e022e-b28e-4ab7-904f-974031423597 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.783618] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a59e022e-b28e-4ab7-904f-974031423597" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.783618] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a59e022e-b28e-4ab7-904f-974031423597" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.783618] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a59e022e-b28e-4ab7-904f-974031423597" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.783618] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a59e022e-b28e-4ab7-904f-974031423597',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.785234] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1260795-50e7-439f-ba84-2ce328b42bf0 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.785234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1260795-50e7-439f-ba84-2ce328b42bf0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.785234] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e9ccf2-d67a-409e-a890-78805a2caa1d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.785234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.813913] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.814168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.818300] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.819274] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e288f5fb-59d8-4807-bc7a-c97f149a17b7 with status ACTIVE [ 947.819602] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.819778] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.819875] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.821158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.821158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.821158] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.821158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.821158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.821158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.821158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.821158] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.821564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.822319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.822319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.822319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.822319] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e288f5fb-59d8-4807-bc7a-c97f149a17b7 is going to be updated. [ 947.842763] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.842947] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.842987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.843201] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.843354] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.843530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e288f5fb-59d8-4807-bc7a-c97f149a17b7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.201638] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1260795-50e7-439f-ba84-2ce328b42bf0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.201638] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.276061] env[69559]: INFO networking_nsxv3.common.synchronization [req-beed448a-7ff1-4244-b6b5-573fbc8e1829 req-f33d4fac-9e19-4391-9089-d2e11c39ede3 tempest-MigrationsAdminTest-370955767 tempest-MigrationsAdminTest-370955767-project-member] Enqueued Resource ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 with Priority: HIGHEST for action security_group_members [ 948.276648] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 with Priority: HIGHEST for action security_group_members [ 948.277021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1260795-50e7-439f-ba84-2ce328b42bf0 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.277165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1260795-50e7-439f-ba84-2ce328b42bf0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.277364] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.277540] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.277615] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.277813] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.277990] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.278234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.278296] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.278468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.278572] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.280281] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.287170] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a59e022e-b28e-4ab7-904f-974031423597 with status ACTIVE [ 948.287170] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.287170] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.287170] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.287170] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.287170] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.287405] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.287405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.288572] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.288572] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.288572] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.288572] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.288572] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.288572] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.293111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.293111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.293111] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a59e022e-b28e-4ab7-904f-974031423597 is going to be updated. [ 948.293332] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e9ccf2-d67a-409e-a890-78805a2caa1d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.293332] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.317058] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.317058] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.317058] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.317410] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.317602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.317780] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a59e022e-b28e-4ab7-904f-974031423597" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.324520] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.484700] env[69559]: INFO networking_nsxv3.common.synchronization [req-a1766e08-29cd-498a-a04b-2a56d20f63d1 req-385b660b-71ef-4060-8432-c9eb56a254d1 tempest-ServerRescueTestJSONUnderV235-7895643 tempest-ServerRescueTestJSONUnderV235-7895643-project-member] Enqueued Resource ID: c1260795-50e7-439f-ba84-2ce328b42bf0 with Priority: HIGHEST for action security_group_members [ 948.484700] env[69559]: INFO networking_nsxv3.common.synchronization [req-a1766e08-29cd-498a-a04b-2a56d20f63d1 req-385b660b-71ef-4060-8432-c9eb56a254d1 tempest-ServerRescueTestJSONUnderV235-7895643 tempest-ServerRescueTestJSONUnderV235-7895643-project-member] Enqueued Resource ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d with Priority: HIGHEST for action security_group_members [ 948.489465] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1260795-50e7-439f-ba84-2ce328b42bf0 with Priority: HIGHEST for action security_group_members [ 948.489465] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d with Priority: HIGHEST for action security_group_members [ 948.489465] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1260795-50e7-439f-ba84-2ce328b42bf0 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.489465] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1260795-50e7-439f-ba84-2ce328b42bf0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.490230] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e9ccf2-d67a-409e-a890-78805a2caa1d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.490553] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.588853] env[69559]: INFO networking_nsxv3.common.synchronization [req-a1766e08-29cd-498a-a04b-2a56d20f63d1 req-385b660b-71ef-4060-8432-c9eb56a254d1 tempest-ServerRescueTestJSONUnderV235-7895643 tempest-ServerRescueTestJSONUnderV235-7895643-project-member] Enqueued Resource ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d with Priority: HIGHEST for action security_group_rules [ 948.588853] env[69559]: INFO networking_nsxv3.common.synchronization [req-a1766e08-29cd-498a-a04b-2a56d20f63d1 req-385b660b-71ef-4060-8432-c9eb56a254d1 tempest-ServerRescueTestJSONUnderV235-7895643 tempest-ServerRescueTestJSONUnderV235-7895643-project-member] Enqueued Resource ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d with Priority: HIGHEST for action security_group_members [ 948.588853] env[69559]: INFO networking_nsxv3.common.synchronization [req-a1766e08-29cd-498a-a04b-2a56d20f63d1 req-385b660b-71ef-4060-8432-c9eb56a254d1 tempest-ServerRescueTestJSONUnderV235-7895643 tempest-ServerRescueTestJSONUnderV235-7895643-project-member] Enqueued Resource ID: a59e022e-b28e-4ab7-904f-974031423597 with Priority: HIGHEST for action port [ 948.588853] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d with Priority: HIGHEST for action security_group_rules [ 948.588853] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d with Priority: HIGHEST for action security_group_members [ 948.588853] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a59e022e-b28e-4ab7-904f-974031423597 with Priority: HIGHEST for action port [ 948.588853] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6e9ccf2-d67a-409e-a890-78805a2caa1d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.588853] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.588853] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e9ccf2-d67a-409e-a890-78805a2caa1d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.588853] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.589283] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-a59e022e-b28e-4ab7-904f-974031423597 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.589283] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a59e022e-b28e-4ab7-904f-974031423597" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.589283] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a59e022e-b28e-4ab7-904f-974031423597" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.589283] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a59e022e-b28e-4ab7-904f-974031423597" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.589720] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a59e022e-b28e-4ab7-904f-974031423597',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.702272] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1260795-50e7-439f-ba84-2ce328b42bf0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.703665] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.785107] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.785107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.785107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.785107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.785107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.785107] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.785451] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.785451] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.785451] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.785628] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.785628] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 is going to be updated. [ 948.810904] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.811168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.811168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.811460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.811612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.820862] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 in Status: IN_PROGRESS for 2s [ 948.826461] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.826708] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.826708] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.826889] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.827065] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.827174] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be created. [ 948.847658] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.847826] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.847918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.848401] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.848401] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.860043] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: UNINITIALIZED for 2s [ 948.882102] env[69559]: INFO networking_nsxv3.common.synchronization [req-d0c55e55-88af-4661-9f82-db3238916d00 req-8487328c-618b-4452-b424-b7f675e48c3f tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 948.882519] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 948.882859] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.882990] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.883086] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.883293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.884037] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.884241] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.884397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.884544] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.884661] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.884786] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.009049] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: SUCCESS [ 949.009545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.009768] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.010025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.011459] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.011459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.011459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.011459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.011459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.011459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.011459] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.094295] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a59e022e-b28e-4ab7-904f-974031423597 with status ACTIVE [ 949.094295] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.094295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.094295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.094295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.094295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.094295] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.094295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.094295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.094295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.094295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.094295] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.094295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.094295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.094295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.094295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.094295] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a59e022e-b28e-4ab7-904f-974031423597 is going to be updated. [ 949.115621] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.115621] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.115621] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.116482] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.116816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.117169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a59e022e-b28e-4ab7-904f-974031423597" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.204922] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.205168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.205314] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.205825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.205825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.205825] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1260795-50e7-439f-ba84-2ce328b42bf0 is going to be created. [ 949.209381] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.209527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.209654] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.209934] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.210086] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.210192] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d is going to be updated. [ 949.240021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.240021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.240278] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.240884] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.240884] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.245293] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.246675] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.246675] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.246675] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.246675] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.256965] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1260795-50e7-439f-ba84-2ce328b42bf0 in Status: UNINITIALIZED for 2s [ 949.257532] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d in Status: IN_PROGRESS for 2s [ 949.388571] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.388763] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.388875] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.389218] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.389369] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.389634] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.389759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.389845] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.390052] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.390139] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.390232] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19282542-923d-4b29-8ce7-e30953449122 is going to be updated. [ 949.428034] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.428034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.428034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.428034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.428034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.436529] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: IN_PROGRESS for 2s [ 949.518193] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.518193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.518193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.518193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.518193] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.518193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.518193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.518193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.518193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.518193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.518193] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.518193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.518193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.518193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.518193] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.518193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.519155] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.519155] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.519155] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.519155] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.519155] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.024262] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55a5191b-a436-4df6-a235-6b2c46e6eea7: rpc.has_security_group_logging(os_id): False [ 950.044397] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.044397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.044397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.044397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.044397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.044397] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.044397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.044397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.044397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.044397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.044397] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.044397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.044397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.044397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.044397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.045120] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.045120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.045120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.045120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.045120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.045120] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 is going to be updated. [ 950.102707] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.102898] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.102939] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.103181] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.103343] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.122491] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: IN_PROGRESS for 2s [ 950.833078] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 in Status: SUCCESS [ 950.833374] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 deletion is rescheduled due to dependency. [ 950.833491] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.870121] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 950.870348] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.870518] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.870793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.870987] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.871120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.871184] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.871345] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.871439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.871531] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.871655] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.268955] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d in Status: SUCCESS [ 951.270018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.270018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.270018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.270252] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.270368] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.272110] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.272110] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.272110] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.272110] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.276331] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1260795-50e7-439f-ba84-2ce328b42bf0 in Status: SUCCESS [ 951.276698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1260795-50e7-439f-ba84-2ce328b42bf0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.276781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1260795-50e7-439f-ba84-2ce328b42bf0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.277024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1260795-50e7-439f-ba84-2ce328b42bf0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.277210] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.277326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.277389] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.277641] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.277751] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.277816] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1260795-50e7-439f-ba84-2ce328b42bf0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.374934] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.376020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.376020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.376020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.376020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.376020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.376020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.376020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.376020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.376313] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.376313] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.376313] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.376472] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.376611] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.376736] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.376825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.376898] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.377048] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.377121] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.377816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.377816] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.401555] env[69559]: INFO networking_nsxv3.common.synchronization [req-b0b3c52b-0188-4e19-a01b-413f68f09f9d req-30922548-654d-4dcb-902d-85072335f0a8 tempest-AttachVolumeNegativeTest-1400300488 tempest-AttachVolumeNegativeTest-1400300488-project-member] Enqueued Resource ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 with Priority: HIGHEST for action security_group_members [ 951.402148] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 with Priority: HIGHEST for action security_group_members [ 951.402556] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.402674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.402674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.402958] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.405323] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.405458] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.405559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.405756] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.406864] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.406864] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bb1158b-fef7-4aa2-82e3-14d38a93d9b2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.447986] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: SUCCESS [ 951.447986] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19282542-923d-4b29-8ce7-e30953449122 deletion is rescheduled due to dependency. [ 951.448192] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.763427] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-979 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.763658] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-979" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.763791] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-979" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.764109] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-979" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.764402] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.764700] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.764700] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.764933] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.765567] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.765818] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 951.765947] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.766078] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.766268] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.766404] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 951.766517] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.766659] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.781556] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.783532] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.783532] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.783532] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.783793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.783793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.783970] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.784107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.784180] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.784365] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.784480] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.784602] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1260795-50e7-439f-ba84-2ce328b42bf0 is going to be deleted. [ 951.790707] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.791124] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 951.791376] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.791703] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-979" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.792469] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-4d779eb8-87b9-4ef2-8b5f-0516d5c0a263 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.792612] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-4d779eb8-87b9-4ef2-8b5f-0516d5c0a263" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.792770] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-4d779eb8-87b9-4ef2-8b5f-0516d5c0a263" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.793199] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-4d779eb8-87b9-4ef2-8b5f-0516d5c0a263" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.793428] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d779eb8-87b9-4ef2-8b5f-0516d5c0a263',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.814911] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.814911] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.815277] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.815277] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.815277] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.815392] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1260795-50e7-439f-ba84-2ce328b42bf0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.815855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1260795-50e7-439f-ba84-2ce328b42bf0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.815855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1260795-50e7-439f-ba84-2ce328b42bf0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.815855] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.816037] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.816037] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.816141] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.816224] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.816320] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1260795-50e7-439f-ba84-2ce328b42bf0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.883459] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebf5f404-8f48-487f-b212-72786dc389e8: rpc.has_security_group_logging(os_id): False [ 951.904510] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.904798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.904798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.904946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.904946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.905172] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.905259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.905314] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.905473] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.905558] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.905803] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.905915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.905995] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.906171] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.906411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.906509] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.906595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.906595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.906725] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.906798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.906892] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be created. [ 951.914345] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.914542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.914542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.914766] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.914887] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.915112] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.915229] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.915282] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.915427] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.915518] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.915591] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 already deleted. [ 951.915674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.968534] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.968720] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.968786] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.969013] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.969318] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.983143] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 952.136870] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: SUCCESS [ 952.137087] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.288150] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.296284] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.296511] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.297031] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.297031] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.297376] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.297376] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 4d779eb8-87b9-4ef2-8b5f-0516d5c0a263 not found, creating... [ 952.297625] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.297830] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.297973] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.298417] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.298417] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.299334] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.299691] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.300290] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.300290] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.300290] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.300399] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 4d779eb8-87b9-4ef2-8b5f-0516d5c0a263 is going to be created. [ 952.318860] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.318860] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.318860] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.319142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.319142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.319269] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.319369] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.319428] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.319799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.319799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.319947] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1260795-50e7-439f-ba84-2ce328b42bf0 already deleted. [ 952.319947] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1260795-50e7-439f-ba84-2ce328b42bf0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.320141] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1260795-50e7-439f-ba84-2ce328b42bf0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.322745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1260795-50e7-439f-ba84-2ce328b42bf0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.322745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1260795-50e7-439f-ba84-2ce328b42bf0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.322745] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.322745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.322745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.322745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.322745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.322745] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1260795-50e7-439f-ba84-2ce328b42bf0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.326770] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.327389] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.327389] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.327518] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.327709] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.328427] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-4d779eb8-87b9-4ef2-8b5f-0516d5c0a263" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.791980] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.792159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.792236] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.792650] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.793137] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.793137] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d is going to be updated. [ 952.821420] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.821619] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.821619] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.821846] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.821997] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.824582] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1260795-50e7-439f-ba84-2ce328b42bf0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.826134] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.826134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.826134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.826134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.826134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.826516] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.826516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.826516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.826516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.826750] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.826750] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1260795-50e7-439f-ba84-2ce328b42bf0 already deleted. [ 952.826750] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1260795-50e7-439f-ba84-2ce328b42bf0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.831251] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d in Status: IN_PROGRESS for 2s [ 953.332517] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1260795-50e7-439f-ba84-2ce328b42bf0: rpc.has_security_group_logging(os_id): False [ 953.354299] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.354299] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.354299] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.354299] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.354532] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.354799] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.354941] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.355105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.355303] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.355427] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.355562] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1260795-50e7-439f-ba84-2ce328b42bf0 is going to be created. [ 953.382639] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/c1260795-50e7-439f-ba84-2ce328b42bf0], does not exist path=[/infra/domains/default/groups/c1260795-50e7-439f-ba84-2ce328b42bf0]."\n}' [ 953.383141] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1260795-50e7-439f-ba84-2ce328b42bf0 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c1260795-50e7-439f-ba84-2ce328b42bf0 [ 953.384206] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 953.453915] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.453915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.453915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.453915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.455535] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.455954] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.456154] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.456257] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.456486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.456722] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.457437] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.457539] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.457713] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.457797] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.457870] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.457972] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1260795-50e7-439f-ba84-2ce328b42bf0 is going to be created. [ 953.477268] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/c1260795-50e7-439f-ba84-2ce328b42bf0], does not exist path=[/infra/domains/default/groups/c1260795-50e7-439f-ba84-2ce328b42bf0]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c1260795-50e7-439f-ba84-2ce328b42bf0 [ 953.478301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1260795-50e7-439f-ba84-2ce328b42bf0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.478301] env[69559]: Traceback (most recent call last): [ 953.478301] env[69559]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 953.478301] env[69559]: return func(*args, **kwargs) [ 953.478301] env[69559]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 953.478301] env[69559]: res.raise_for_status() [ 953.478301] env[69559]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 953.478301] env[69559]: raise HTTPError(http_error_msg, response=self) [ 953.478301] env[69559]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c1260795-50e7-439f-ba84-2ce328b42bf0 [ 953.478301] env[69559]: During handling of the above exception, another exception occurred: [ 953.478301] env[69559]: Traceback (most recent call last): [ 953.478301] env[69559]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 953.478301] env[69559]: listener.cb(fileno) [ 953.478301] env[69559]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 953.478301] env[69559]: result = function(*args, **kwargs) [ 953.478301] env[69559]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 953.478301] env[69559]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 953.478301] env[69559]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 953.478301] env[69559]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 953.478301] env[69559]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 953.478301] env[69559]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 953.478301] env[69559]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 953.478301] env[69559]: res.raise_for_status() [ 953.478301] env[69559]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 953.478301] env[69559]: raise HTTPError(http_error_msg, response=self) [ 953.478301] env[69559]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c1260795-50e7-439f-ba84-2ce328b42bf0 [ 953.478301] env[69559]: Removing descriptor: 57 [ 953.596826] env[69559]: INFO networking_nsxv3.common.synchronization [req-b0b3c52b-0188-4e19-a01b-413f68f09f9d req-b44e8c3b-4a2c-47cf-96bd-9c28e315dfd0 service nova] Enqueued Resource ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 with Priority: HIGHEST for action security_group_rules [ 953.597083] env[69559]: INFO networking_nsxv3.common.synchronization [req-b0b3c52b-0188-4e19-a01b-413f68f09f9d req-b44e8c3b-4a2c-47cf-96bd-9c28e315dfd0 service nova] Enqueued Resource ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 with Priority: HIGHEST for action security_group_members [ 953.597245] env[69559]: INFO networking_nsxv3.common.synchronization [req-b0b3c52b-0188-4e19-a01b-413f68f09f9d req-b44e8c3b-4a2c-47cf-96bd-9c28e315dfd0 service nova] Enqueued Resource ID: 4d779eb8-87b9-4ef2-8b5f-0516d5c0a263 with Priority: HIGHEST for action port [ 953.597854] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 with Priority: HIGHEST for action security_group_rules [ 953.597996] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 with Priority: HIGHEST for action security_group_members [ 953.598200] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d779eb8-87b9-4ef2-8b5f-0516d5c0a263 with Priority: HIGHEST for action port [ 953.598572] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.598728] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.598852] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.599146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.599345] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bb1158b-fef7-4aa2-82e3-14d38a93d9b2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.600287] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.600467] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.600967] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.601253] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.601465] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.601634] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.601735] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.601941] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.602112] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.602255] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bb1158b-fef7-4aa2-82e3-14d38a93d9b2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.603172] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d779eb8-87b9-4ef2-8b5f-0516d5c0a263 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.603337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d779eb8-87b9-4ef2-8b5f-0516d5c0a263" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.603492] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d779eb8-87b9-4ef2-8b5f-0516d5c0a263" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.603697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d779eb8-87b9-4ef2-8b5f-0516d5c0a263" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.603814] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d779eb8-87b9-4ef2-8b5f-0516d5c0a263',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.996126] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 953.996367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.046396] env[69559]: INFO networking_nsxv3.common.synchronization [req-1d1c9e4f-41fc-4326-8a85-6a6480de7a14 req-c07dc0d5-35e6-4e11-be49-31c82679a5ec tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 with Priority: HIGHEST for action security_group_members [ 954.047269] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 with Priority: HIGHEST for action security_group_members [ 954.047269] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-858bd0a1-9ee5-49c8-ac77-f218758ad913 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.047520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.047520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.047661] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.047819] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.047910] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.047969] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.049019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.049124] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.049221] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('858bd0a1-9ee5-49c8-ac77-f218758ad913',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.105930] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2bb1158b-fef7-4aa2-82e3-14d38a93d9b2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.110156] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.110156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.110156] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d779eb8-87b9-4ef2-8b5f-0516d5c0a263 with status ACTIVE [ 954.110156] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.110156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.110156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.110156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.110156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.110156] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.110156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.110156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.110156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.110156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.110156] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.110697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.110697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.110697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.110697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.110697] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d779eb8-87b9-4ef2-8b5f-0516d5c0a263 is going to be updated. [ 954.131974] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.132230] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.132230] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.133653] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.133653] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.133653] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d779eb8-87b9-4ef2-8b5f-0516d5c0a263" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.554210] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.554210] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.554210] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.554210] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.575042] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.575576] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.575883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.576121] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.576471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.576704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.578023] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 is going to be updated. [ 954.598073] env[69559]: INFO networking_nsxv3.common.synchronization [None req-1bed015e-9323-44c4-be90-bf4f1838b617 None None] Enqueued Resource ID: 61ac0971-c7d7-4bb6-b0bb-a7ddea7e428c with Priority: HIGHEST for action port [ 954.598073] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61ac0971-c7d7-4bb6-b0bb-a7ddea7e428c with Priority: HIGHEST for action port [ 954.598073] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-61ac0971-c7d7-4bb6-b0bb-a7ddea7e428c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.598073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61ac0971-c7d7-4bb6-b0bb-a7ddea7e428c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.598073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61ac0971-c7d7-4bb6-b0bb-a7ddea7e428c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.598073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61ac0971-c7d7-4bb6-b0bb-a7ddea7e428c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.598073] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61ac0971-c7d7-4bb6-b0bb-a7ddea7e428c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.603805] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.603805] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.603805] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.603805] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.603805] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.610476] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 in Status: IN_PROGRESS for 2s [ 954.614584] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2bb1158b-fef7-4aa2-82e3-14d38a93d9b2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.844211] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d in Status: SUCCESS [ 954.844490] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.844729] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.844903] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.845758] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.845758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.845758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.845758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.845758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.845758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.845758] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.846715] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.846879] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.847055] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.847159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.847221] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.847360] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.847453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.847527] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.101183] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61ac0971-c7d7-4bb6-b0bb-a7ddea7e428c [ 955.101642] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.101790] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.101790] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.102015] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.102115] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.102212] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61ac0971-c7d7-4bb6-b0bb-a7ddea7e428c already deleted. [ 955.102296] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61ac0971-c7d7-4bb6-b0bb-a7ddea7e428c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.116574] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.116574] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.116574] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.116574] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.116574] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.116574] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 is going to be created. [ 955.139476] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.139754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.139847] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.140078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.140252] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.149233] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 in Status: UNINITIALIZED for 2s [ 955.350954] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e9ccf2-d67a-409e-a890-78805a2caa1d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.350954] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.350954] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.852744] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.358097] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.358939] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.359107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.359800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.359958] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.360307] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d is going to be updated. [ 956.390399] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.390561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.390674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.390883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.391030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.399596] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d in Status: IN_PROGRESS for 2s [ 956.619983] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 in Status: SUCCESS [ 956.620198] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 deletion is rescheduled due to dependency. [ 956.620321] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.162109] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 in Status: SUCCESS [ 957.162109] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.162109] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.162109] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.162109] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.162109] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.162109] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.162109] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.162109] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.162109] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.162109] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2bb1158b-fef7-4aa2-82e3-14d38a93d9b2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.263105] env[69559]: INFO networking_nsxv3.common.synchronization [None req-fa447e0e-af56-48c8-b3ba-cef7eebd4f59 None None] Enqueued Resource ID: 7935c3ce-4536-44a6-a552-7281c5e0055e with Priority: HIGHEST for action port [ 957.265390] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7935c3ce-4536-44a6-a552-7281c5e0055e with Priority: HIGHEST for action port [ 957.265711] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-7935c3ce-4536-44a6-a552-7281c5e0055e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.265862] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7935c3ce-4536-44a6-a552-7281c5e0055e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.265937] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7935c3ce-4536-44a6-a552-7281c5e0055e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.266206] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7935c3ce-4536-44a6-a552-7281c5e0055e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.267057] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7935c3ce-4536-44a6-a552-7281c5e0055e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.672140] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2bb1158b-fef7-4aa2-82e3-14d38a93d9b2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.772567] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7935c3ce-4536-44a6-a552-7281c5e0055e [ 957.772567] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.772567] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.772567] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.772567] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.772567] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.772567] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7935c3ce-4536-44a6-a552-7281c5e0055e already deleted. [ 957.772567] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7935c3ce-4536-44a6-a552-7281c5e0055e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.175814] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2: rpc.has_security_group_logging(os_id): False [ 958.197657] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.197825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.197917] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.198199] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.200060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.200060] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.200060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.200060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.200060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.200060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.200060] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 is going to be created. [ 958.269748] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.269928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.269999] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.270279] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.270503] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.436609] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d in Status: SUCCESS [ 958.436844] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.437032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.437252] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.437831] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.437831] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.437831] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.438026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.438026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.438085] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.439471] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 in Status: IN_PROGRESS for 2s [ 958.941880] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.978118] env[69559]: INFO networking_nsxv3.common.synchronization [req-82c608bf-ef57-464a-82fa-0d4411cfd0e8 req-f5c282de-5aad-40a4-bcaa-7b97dfa3fc69 tempest-ServerRescueTestJSONUnderV235-7895643 tempest-ServerRescueTestJSONUnderV235-7895643-project-member] Enqueued Resource ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d with Priority: HIGHEST for action security_group_members [ 958.978629] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d with Priority: HIGHEST for action security_group_members [ 958.978944] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e9ccf2-d67a-409e-a890-78805a2caa1d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.979046] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.443962] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.864667] env[69559]: INFO networking_nsxv3.common.synchronization [req-0ab8bb10-de4b-401c-a9f6-cfd80cbb7f04 req-02a6ce29-6757-4aa3-b741-2c82b7daf8f6 tempest-ListServerFiltersTestJSON-1483085772 tempest-ListServerFiltersTestJSON-1483085772-project-member] Enqueued Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_members [ 959.865513] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_members [ 959.866139] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.866268] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.866268] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.866554] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.866870] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.866954] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.867059] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.867793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.867793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.867793] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.948552] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.948763] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.948862] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.949641] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.949741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.949814] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d is going to be updated. [ 959.977014] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.977206] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.977301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.977533] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.977700] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.989552] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d in Status: IN_PROGRESS for 2s [ 960.371752] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.459440] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 in Status: SUCCESS [ 960.459697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.874113] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.258082] env[69559]: INFO networking_nsxv3.common.synchronization [None req-bb5f31c1-1935-4b10-a750-14557acda0f4 None None] Enqueued Resource ID: 5e613ba6-b13c-47bf-939b-1e644407accf with Priority: HIGHEST for action port [ 961.258082] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e613ba6-b13c-47bf-939b-1e644407accf with Priority: HIGHEST for action port [ 961.258082] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e613ba6-b13c-47bf-939b-1e644407accf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.258082] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e613ba6-b13c-47bf-939b-1e644407accf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.258082] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e613ba6-b13c-47bf-939b-1e644407accf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.258082] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e613ba6-b13c-47bf-939b-1e644407accf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.258082] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e613ba6-b13c-47bf-939b-1e644407accf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.377040] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.377238] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.377313] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.377700] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.377700] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.377799] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf is going to be updated. [ 961.407850] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.407991] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.408120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.408290] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.408430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.417374] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf in Status: IN_PROGRESS for 2s [ 961.501951] env[69559]: INFO networking_nsxv3.common.synchronization [req-f0dadb98-4e91-41c0-897f-bf2033b982e7 req-f84b75c4-ec8f-4b47-b3bc-c656a00f63a6 tempest-DeleteServersTestJSON-1423597435 tempest-DeleteServersTestJSON-1423597435-project-member] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 961.505576] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 961.505967] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.506117] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.506182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.506421] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.506590] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.506705] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.506764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.506969] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.507029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.507138] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.764728] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e613ba6-b13c-47bf-939b-1e644407accf [ 961.765008] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.765211] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.765338] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.765984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.765984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.765984] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e613ba6-b13c-47bf-939b-1e644407accf already deleted. [ 961.765984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e613ba6-b13c-47bf-939b-1e644407accf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.867218] env[69559]: INFO networking_nsxv3.common.synchronization [req-67ba9406-c1a6-4f3d-a8aa-604f1ccfe65a req-93bd74ff-995f-44ad-b886-0ef87ae0840c tempest-VolumesAdminNegativeTest-1895972689 tempest-VolumesAdminNegativeTest-1895972689-project-member] Enqueued Resource ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e with Priority: HIGHEST for action security_group_members [ 961.871836] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e with Priority: HIGHEST for action security_group_members [ 961.872484] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-acb5a9fe-3650-403a-90f4-19ec52b5f97e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.872484] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.872484] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.872746] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.872746] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.872846] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.872904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.873056] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.873308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.873308] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('acb5a9fe-3650-403a-90f4-19ec52b5f97e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.000283] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d in Status: SUCCESS [ 962.000502] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.000789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.000955] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.001134] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.003806] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.003806] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.003806] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.003806] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.004114] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.004114] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6e9ccf2-d67a-409e-a890-78805a2caa1d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.004260] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.004260] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.004385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.004516] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.004610] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.004666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.004799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.004872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.005139] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.005139] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.005978] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.006153] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.006344] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.006414] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.006467] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.006674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.006951] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.006951] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.009727] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.009997] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.010098] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.010599] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.029169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.029231] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.029481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.029481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.029666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.029775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.030262] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be updated. [ 962.059262] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.059453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.059601] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.059789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.059940] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.070115] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 962.377110] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.379276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.379276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.379276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.399885] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.399885] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.399885] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.399885] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.399885] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.399885] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.399885] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e is going to be updated. [ 962.424523] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.425335] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.425335] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.425335] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.425335] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.436511] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e in Status: IN_PROGRESS for 2s [ 962.510904] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.513096] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.513096] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.513096] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.513096] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6e9ccf2-d67a-409e-a890-78805a2caa1d: rpc.has_security_group_logging(os_id): False [ 962.533187] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.534845] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.535024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.535581] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.536423] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.536423] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.536423] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d is going to be updated. [ 962.538727] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.539459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.539459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.539693] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.539824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.540083] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.540225] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.540840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.541063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.541219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.541493] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.541637] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.541735] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.542055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.542169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.542390] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.542557] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.542617] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.542783] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.542888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.542995] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d is going to be updated. [ 962.571184] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.571340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.572164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.572164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.572164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.579959] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d in Status: IN_PROGRESS for 2s [ 962.618402] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.618518] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.618587] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.618800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.618943] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.633291] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d in Status: IN_PROGRESS for 2s [ 963.017690] env[69559]: INFO networking_nsxv3.common.synchronization [req-a4b9756d-f698-42a2-a6f0-dfc915ccfc4a req-5b3cd959-888f-4b34-bf63-236445db6835 tempest-ImagesTestJSON-1150485476 tempest-ImagesTestJSON-1150485476-project-member] Enqueued Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 963.018315] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 963.018710] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.018876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.018942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.019191] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.019358] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.019473] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.019540] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.019702] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.019830] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.019968] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.428475] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf in Status: SUCCESS [ 963.428709] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.525428] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.030079] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.080516] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 964.080646] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d deletion is rescheduled due to dependency. [ 964.080772] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.099873] env[69559]: INFO networking_nsxv3.common.synchronization [None req-f7e270e6-0da1-4e78-92e2-564a2918729c None None] Enqueued Resource ID: 1b0cfd69-5a34-44da-821d-9d27146041b1 with Priority: HIGHEST for action port [ 964.099873] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b0cfd69-5a34-44da-821d-9d27146041b1 with Priority: HIGHEST for action port [ 964.101833] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b0cfd69-5a34-44da-821d-9d27146041b1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.101833] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b0cfd69-5a34-44da-821d-9d27146041b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.101833] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b0cfd69-5a34-44da-821d-9d27146041b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.101833] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b0cfd69-5a34-44da-821d-9d27146041b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.101833] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b0cfd69-5a34-44da-821d-9d27146041b1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.446954] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e in Status: SUCCESS [ 964.447090] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e deletion is rescheduled due to dependency. [ 964.447214] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.534569] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.534569] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.534569] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.534569] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.534569] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.534569] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 is going to be updated. [ 964.561228] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.561228] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.561228] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.561228] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.561228] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.568217] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: IN_PROGRESS for 2s [ 964.588612] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d in Status: SUCCESS [ 964.588899] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d deletion is rescheduled due to dependency. [ 964.589124] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.605292] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b0cfd69-5a34-44da-821d-9d27146041b1 [ 964.606704] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.606704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.606704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.606704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.606704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.606704] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b0cfd69-5a34-44da-821d-9d27146041b1 already deleted. [ 964.606704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b0cfd69-5a34-44da-821d-9d27146041b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.653208] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d in Status: SUCCESS [ 964.653208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.653208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.653208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.653208] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6e9ccf2-d67a-409e-a890-78805a2caa1d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.170047] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.170211] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.170292] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.170478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.170938] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.170938] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6e9ccf2-d67a-409e-a890-78805a2caa1d is going to be deleted. [ 965.231997] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.232507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.232507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.232507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.232647] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.233095] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6e9ccf2-d67a-409e-a890-78805a2caa1d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.254109] env[69559]: INFO networking_nsxv3.common.synchronization [req-35d8946e-b7da-4362-9b40-f74b2eac74ec req-e6faca58-ebb8-49d6-9008-701a039ec6b1 tempest-ServersTestManualDisk-1543198047 tempest-ServersTestManualDisk-1543198047-project-member] Enqueued Resource ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 with Priority: HIGHEST for action security_group_members [ 965.254442] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 with Priority: HIGHEST for action security_group_members [ 965.254442] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-50135ff4-8447-455b-b0a1-ca85f9b5ef55 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.254574] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.254620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.254953] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.255117] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.255215] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.255274] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.255969] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.255969] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.255969] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50135ff4-8447-455b-b0a1-ca85f9b5ef55',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.576140] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-981 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.576140] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-981" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.576140] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-981" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.576140] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-981" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.576140] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.577369] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.580904] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.580904] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.580904] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.580904] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 965.580904] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 965.580904] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 965.580904] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 965.580904] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 965.580904] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 965.580904] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 965.599282] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 965.599282] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 965.599282] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 965.599282] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-981" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.599538] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-5ef819e6-1ea0-439b-aafe-b1d2754476db taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.599538] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-5ef819e6-1ea0-439b-aafe-b1d2754476db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.599646] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-5ef819e6-1ea0-439b-aafe-b1d2754476db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.600494] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-5ef819e6-1ea0-439b-aafe-b1d2754476db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.600494] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ef819e6-1ea0-439b-aafe-b1d2754476db',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.757447] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.758342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.758342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.758342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.758342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.759739] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.759739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.759739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.759739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.759739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.759739] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 already deleted. [ 965.759739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.103140] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.103380] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.103520] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.103863] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.104099] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.104233] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 5ef819e6-1ea0-439b-aafe-b1d2754476db not found, creating... [ 966.104504] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.104722] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.104857] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.105113] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.105289] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.105636] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.105806] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.105936] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.106193] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.106374] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.106530] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 5ef819e6-1ea0-439b-aafe-b1d2754476db is going to be created. [ 966.125697] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.125925] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.126068] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.126348] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.126631] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.126813] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-5ef819e6-1ea0-439b-aafe-b1d2754476db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.578448] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: SUCCESS [ 966.578777] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.944941] env[69559]: INFO networking_nsxv3.common.synchronization [None req-f60c3c6f-c10b-43a4-b711-715456847221 None None] Enqueued Resource ID: 73034446-bf61-4e92-999e-bd3899b98d24 with Priority: HIGHEST for action port [ 966.945569] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73034446-bf61-4e92-999e-bd3899b98d24 with Priority: HIGHEST for action port [ 966.945961] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-73034446-bf61-4e92-999e-bd3899b98d24 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.946139] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73034446-bf61-4e92-999e-bd3899b98d24" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.946251] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73034446-bf61-4e92-999e-bd3899b98d24" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.946571] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73034446-bf61-4e92-999e-bd3899b98d24" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.946721] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73034446-bf61-4e92-999e-bd3899b98d24',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.030607] env[69559]: INFO networking_nsxv3.common.synchronization [req-35d8946e-b7da-4362-9b40-f74b2eac74ec req-73e42314-696a-4b31-9bea-06c6f7fa019b service nova] Enqueued Resource ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 with Priority: HIGHEST for action security_group_rules [ 967.031890] env[69559]: INFO networking_nsxv3.common.synchronization [req-35d8946e-b7da-4362-9b40-f74b2eac74ec req-73e42314-696a-4b31-9bea-06c6f7fa019b service nova] Enqueued Resource ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 with Priority: HIGHEST for action security_group_members [ 967.031890] env[69559]: INFO networking_nsxv3.common.synchronization [req-35d8946e-b7da-4362-9b40-f74b2eac74ec req-73e42314-696a-4b31-9bea-06c6f7fa019b service nova] Enqueued Resource ID: 5ef819e6-1ea0-439b-aafe-b1d2754476db with Priority: HIGHEST for action port [ 967.032036] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 with Priority: HIGHEST for action security_group_rules [ 967.032244] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 with Priority: HIGHEST for action security_group_members [ 967.032286] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ef819e6-1ea0-439b-aafe-b1d2754476db with Priority: HIGHEST for action port [ 967.032594] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50135ff4-8447-455b-b0a1-ca85f9b5ef55 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.032797] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.032972] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.033266] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.033797] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50135ff4-8447-455b-b0a1-ca85f9b5ef55',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.037363] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-50135ff4-8447-455b-b0a1-ca85f9b5ef55 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.037529] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.037598] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.037812] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.037984] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.038119] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.038194] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.038320] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.038402] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.040258] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50135ff4-8447-455b-b0a1-ca85f9b5ef55',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.040258] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ef819e6-1ea0-439b-aafe-b1d2754476db taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.040258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ef819e6-1ea0-439b-aafe-b1d2754476db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.040258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ef819e6-1ea0-439b-aafe-b1d2754476db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.040258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ef819e6-1ea0-439b-aafe-b1d2754476db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.040258] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ef819e6-1ea0-439b-aafe-b1d2754476db',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.451336] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73034446-bf61-4e92-999e-bd3899b98d24 [ 967.452297] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.452297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.452297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.452297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.452297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.452297] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73034446-bf61-4e92-999e-bd3899b98d24 already deleted. [ 967.452297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73034446-bf61-4e92-999e-bd3899b98d24" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.546422] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-50135ff4-8447-455b-b0a1-ca85f9b5ef55 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.546422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.549076] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50135ff4-8447-455b-b0a1-ca85f9b5ef55',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.549076] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ef819e6-1ea0-439b-aafe-b1d2754476db with status ACTIVE [ 967.549076] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.549076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.549076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.549076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.549076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.549076] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.549581] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.549849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.550177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.550620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.551211] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.551478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.551712] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.552033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.552217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.552393] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ef819e6-1ea0-439b-aafe-b1d2754476db is going to be updated. [ 967.574514] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.574514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.574514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.574514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.574514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.574514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ef819e6-1ea0-439b-aafe-b1d2754476db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.054519] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50135ff4-8447-455b-b0a1-ca85f9b5ef55',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.559566] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.559566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.559566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.559566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.559853] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.559853] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 is going to be created. [ 968.581384] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.581561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.581620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.581825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.582119] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.590791] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 in Status: UNINITIALIZED for 2s [ 969.270435] env[69559]: INFO networking_nsxv3.common.synchronization [req-56fcb06b-0878-4c7a-9ce5-ec8f30656ccc req-d262b3c6-8bef-4899-9fee-b4ec860d3749 tempest-ServerActionsTestOtherA-1414477814 tempest-ServerActionsTestOtherA-1414477814-project-member] Enqueued Resource ID: e29c3806-d806-4df2-8a52-0ecf9da87984 with Priority: HIGHEST for action security_group_members [ 969.271062] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e29c3806-d806-4df2-8a52-0ecf9da87984 with Priority: HIGHEST for action security_group_members [ 969.271402] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e29c3806-d806-4df2-8a52-0ecf9da87984 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.271539] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.271606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.271802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.271973] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.272246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.272324] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.272481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.272563] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.272658] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e29c3806-d806-4df2-8a52-0ecf9da87984',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.336396] env[69559]: INFO networking_nsxv3.common.synchronization [None req-b66995c7-5763-4830-b703-c28838c2f3de None None] Enqueued Resource ID: c230d057-c5bf-457b-86f9-76ed219b4646 with Priority: HIGHEST for action port [ 969.337559] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c230d057-c5bf-457b-86f9-76ed219b4646 with Priority: HIGHEST for action port [ 969.339361] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-c230d057-c5bf-457b-86f9-76ed219b4646 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.339501] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c230d057-c5bf-457b-86f9-76ed219b4646" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.339577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c230d057-c5bf-457b-86f9-76ed219b4646" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.339868] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c230d057-c5bf-457b-86f9-76ed219b4646" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.339957] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c230d057-c5bf-457b-86f9-76ed219b4646',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.774631] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.774871] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.774958] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.775289] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.799860] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.799860] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.799860] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.799860] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.799860] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.799860] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.799860] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e29c3806-d806-4df2-8a52-0ecf9da87984 is going to be updated. [ 969.841049] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.841211] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.841280] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.841490] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.841652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.843329] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c230d057-c5bf-457b-86f9-76ed219b4646 [ 969.843606] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.844513] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.844513] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.844513] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.844513] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.844513] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c230d057-c5bf-457b-86f9-76ed219b4646 already deleted. [ 969.844513] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c230d057-c5bf-457b-86f9-76ed219b4646" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.854420] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e29c3806-d806-4df2-8a52-0ecf9da87984 in Status: IN_PROGRESS for 2s [ 970.185032] env[69559]: INFO networking_nsxv3.common.synchronization [None req-40db77c5-aa15-4b13-824c-890f3957c36e tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 868ef973-ca6a-480b-be75-839232b752db with Priority: HIGHEST for action security_group_rules [ 970.186122] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 868ef973-ca6a-480b-be75-839232b752db with Priority: HIGHEST for action security_group_rules [ 970.186391] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-868ef973-ca6a-480b-be75-839232b752db taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.186592] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.186719] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.187090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.189069] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('868ef973-ca6a-480b-be75-839232b752db',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.302013] env[69559]: INFO networking_nsxv3.common.synchronization [None req-e43b4f3a-6752-43c9-8273-d4ee0275e60d tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 868ef973-ca6a-480b-be75-839232b752db with Priority: HIGHEST for action security_group_rules [ 970.303747] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 868ef973-ca6a-480b-be75-839232b752db with Priority: HIGHEST for action security_group_rules [ 970.303747] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-868ef973-ca6a-480b-be75-839232b752db taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.303747] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.409571] env[69559]: INFO networking_nsxv3.common.synchronization [None req-441af18a-5a64-4a77-a2bf-b9d7dab61b46 None None] Enqueued Resource ID: 7a95fd03-346d-4829-a7b7-9d8c4d0c4139 with Priority: HIGHEST for action port [ 970.409811] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a95fd03-346d-4829-a7b7-9d8c4d0c4139 with Priority: HIGHEST for action port [ 970.410180] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a95fd03-346d-4829-a7b7-9d8c4d0c4139 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.410342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a95fd03-346d-4829-a7b7-9d8c4d0c4139" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.410754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a95fd03-346d-4829-a7b7-9d8c4d0c4139" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.411063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a95fd03-346d-4829-a7b7-9d8c4d0c4139" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.411184] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a95fd03-346d-4829-a7b7-9d8c4d0c4139',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.604018] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 in Status: SUCCESS [ 970.604018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.604018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.604018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.604018] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.604018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.604018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.604018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.604018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.604018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.604018] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50135ff4-8447-455b-b0a1-ca85f9b5ef55',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.708097] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.708256] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.708543] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.708543] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.708649] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.708802] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 868ef973-ca6a-480b-be75-839232b752db already deleted. [ 970.708802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.708946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.709164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.709233] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('868ef973-ca6a-480b-be75-839232b752db',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.914631] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a95fd03-346d-4829-a7b7-9d8c4d0c4139 [ 970.914885] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.915044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.915116] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.915682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.915682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.915682] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a95fd03-346d-4829-a7b7-9d8c4d0c4139 already deleted. [ 970.915682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a95fd03-346d-4829-a7b7-9d8c4d0c4139" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.106564] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50135ff4-8447-455b-b0a1-ca85f9b5ef55',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.232796] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.234025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.234025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.234025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.234025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.234025] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 868ef973-ca6a-480b-be75-839232b752db already deleted. [ 971.234025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.611017] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50135ff4-8447-455b-b0a1-ca85f9b5ef55: rpc.has_security_group_logging(os_id): False [ 971.628470] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.628670] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.628782] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.629014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.629123] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.629412] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.629515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.629577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.632536] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.632536] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.632536] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 is going to be created. [ 971.687620] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.688430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.688430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.688430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.689038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.714491] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 in Status: IN_PROGRESS for 2s [ 971.863777] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e29c3806-d806-4df2-8a52-0ecf9da87984 in Status: SUCCESS [ 971.863973] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e29c3806-d806-4df2-8a52-0ecf9da87984 deletion is rescheduled due to dependency. [ 971.864112] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.008322] env[69559]: INFO networking_nsxv3.common.synchronization [req-a84dc42c-ca92-4692-b772-1c5ce72c5959 req-9c959ad6-47af-4aee-b79f-67a6e5d68722 tempest-ImagesOneServerTestJSON-1917568187 tempest-ImagesOneServerTestJSON-1917568187-project-member] Enqueued Resource ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f with Priority: HIGHEST for action security_group_members [ 972.008322] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f with Priority: HIGHEST for action security_group_members [ 972.008487] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.008547] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.008583] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.008830] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.009433] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.009561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.009561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.009721] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.009792] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.009924] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f12ab78c-28a7-4f2b-a14e-b0a92a64233f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.352118] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-413 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.352118] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-413" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.352118] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-413" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.352118] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-413" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.352118] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.352118] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.352118] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.352594] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.352594] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.352715] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.352823] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 972.352933] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 972.353085] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 972.353209] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.353316] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 972.353449] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 972.373020] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 972.373020] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 972.373020] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 972.373020] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-413" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.373020] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-3921d169-26ec-401e-921b-df287d976d15 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.373020] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-3921d169-26ec-401e-921b-df287d976d15" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.373020] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-3921d169-26ec-401e-921b-df287d976d15" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.373020] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-3921d169-26ec-401e-921b-df287d976d15" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.373020] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3921d169-26ec-401e-921b-df287d976d15',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.518636] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.518795] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.518870] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.519105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.519197] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.519389] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.519492] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.519557] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.519704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.519812] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.519898] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f already deleted. [ 972.519977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.657183] env[69559]: INFO networking_nsxv3.common.synchronization [None req-1c236c5c-a0c1-4f64-b45d-8a31a5c03216 None None] Enqueued Resource ID: a58d7920-1a5c-4290-9ba8-1ea708d3cd17 with Priority: HIGHEST for action port [ 972.657690] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a58d7920-1a5c-4290-9ba8-1ea708d3cd17 with Priority: HIGHEST for action port [ 972.657993] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-a58d7920-1a5c-4290-9ba8-1ea708d3cd17 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.658122] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a58d7920-1a5c-4290-9ba8-1ea708d3cd17" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.658185] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a58d7920-1a5c-4290-9ba8-1ea708d3cd17" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.658420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a58d7920-1a5c-4290-9ba8-1ea708d3cd17" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.658509] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a58d7920-1a5c-4290-9ba8-1ea708d3cd17',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.876025] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.876167] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.876301] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.876583] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.876746] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.876903] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 3921d169-26ec-401e-921b-df287d976d15 not found, creating... [ 972.877184] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.877350] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.877475] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.877702] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.877854] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.878142] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.878344] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.878476] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.878689] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.878912] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.879074] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 3921d169-26ec-401e-921b-df287d976d15 is going to be created. [ 972.898495] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.898682] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.898837] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.899091] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.899318] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.899537] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-3921d169-26ec-401e-921b-df287d976d15" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.161226] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a58d7920-1a5c-4290-9ba8-1ea708d3cd17 [ 973.161580] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.161726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.161799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.162083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.162209] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.162312] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a58d7920-1a5c-4290-9ba8-1ea708d3cd17 already deleted. [ 973.162398] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a58d7920-1a5c-4290-9ba8-1ea708d3cd17" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.667663] env[69559]: INFO networking_nsxv3.common.synchronization [req-a84dc42c-ca92-4692-b772-1c5ce72c5959 req-cba5deb8-e2f8-46ba-bdfa-5aa1597f6e93 service nova] Enqueued Resource ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f with Priority: HIGHEST for action security_group_rules [ 973.667663] env[69559]: INFO networking_nsxv3.common.synchronization [req-a84dc42c-ca92-4692-b772-1c5ce72c5959 req-cba5deb8-e2f8-46ba-bdfa-5aa1597f6e93 service nova] Enqueued Resource ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f with Priority: HIGHEST for action security_group_members [ 973.667663] env[69559]: INFO networking_nsxv3.common.synchronization [req-a84dc42c-ca92-4692-b772-1c5ce72c5959 req-cba5deb8-e2f8-46ba-bdfa-5aa1597f6e93 service nova] Enqueued Resource ID: 3921d169-26ec-401e-921b-df287d976d15 with Priority: HIGHEST for action port [ 973.668162] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f with Priority: HIGHEST for action security_group_rules [ 973.668162] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f with Priority: HIGHEST for action security_group_members [ 973.668162] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3921d169-26ec-401e-921b-df287d976d15 with Priority: HIGHEST for action port [ 973.668598] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f12ab78c-28a7-4f2b-a14e-b0a92a64233f taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.668694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.668694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.668985] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.669136] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f12ab78c-28a7-4f2b-a14e-b0a92a64233f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.676851] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.676851] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.676851] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.676851] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.676851] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.676851] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.677345] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.677345] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.677345] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.677345] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f12ab78c-28a7-4f2b-a14e-b0a92a64233f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.678357] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-3921d169-26ec-401e-921b-df287d976d15 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.678503] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3921d169-26ec-401e-921b-df287d976d15" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.678606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3921d169-26ec-401e-921b-df287d976d15" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.679358] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3921d169-26ec-401e-921b-df287d976d15" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.679358] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3921d169-26ec-401e-921b-df287d976d15',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.728795] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 in Status: SUCCESS [ 973.728795] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.182206] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f12ab78c-28a7-4f2b-a14e-b0a92a64233f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.184375] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.184375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.184375] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3921d169-26ec-401e-921b-df287d976d15 with status ACTIVE [ 974.184375] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.184375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.184375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.184375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.184375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.184375] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.184375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.184375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.184375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.184375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.188361] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.188460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.188501] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.188642] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.188735] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.188849] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3921d169-26ec-401e-921b-df287d976d15 is going to be updated. [ 974.211379] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.211527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.211599] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.211797] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.211928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.212160] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3921d169-26ec-401e-921b-df287d976d15" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.684216] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f12ab78c-28a7-4f2b-a14e-b0a92a64233f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.188627] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.188855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.188988] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.189252] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.189352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.189489] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f is going to be created. [ 975.221453] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.221453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.221453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.221453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.221453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.230245] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f in Status: UNINITIALIZED for 2s [ 977.240661] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f in Status: SUCCESS [ 977.241069] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.241069] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.241258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.241799] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.241799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.241799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.241799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.242016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.242016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.242086] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f12ab78c-28a7-4f2b-a14e-b0a92a64233f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.745022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.745022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.745286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.745286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.745465] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.745564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.745650] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.747623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.747623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.747623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.747623] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.747623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.747623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.747623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.747623] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.747623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.752024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.752024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.752024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.752024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.752024] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f12ab78c-28a7-4f2b-a14e-b0a92a64233f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.252095] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f12ab78c-28a7-4f2b-a14e-b0a92a64233f: rpc.has_security_group_logging(os_id): False [ 978.270500] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.270777] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.270777] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.270981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.271104] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.271341] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.271434] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.271491] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.271669] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.271754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.271968] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.272119] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.272185] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.272347] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.272419] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.272618] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.272715] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.272779] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.272947] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.273058] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.273131] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f is going to be created. [ 978.329495] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.329711] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.329896] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.330087] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.330299] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.339596] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f in Status: IN_PROGRESS for 2s [ 978.671215] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 978.671215] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 978.782708] env[69559]: INFO networking_nsxv3.common.synchronization [req-45e137b3-8fe0-425b-a952-425c58fd53dc req-91ece9e6-d5e7-4bc3-8291-25ec7d3b26d8 tempest-ServersTestJSON-514909010 tempest-ServersTestJSON-514909010-project-member] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 978.783360] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 978.783703] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.783825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.783891] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.784305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.784468] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.784591] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.784651] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.784809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.784890] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.784991] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.924867] env[69559]: INFO networking_nsxv3.common.synchronization [req-b031c43e-060f-4c1e-8b0b-96719453505f req-58c37626-f7a7-4a93-87a5-a8e868ac8da1 tempest-ListServerFiltersTestJSON-1483085772 tempest-ListServerFiltersTestJSON-1483085772-project-member] Enqueued Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_members [ 978.925585] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGHEST for action security_group_members [ 978.925994] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.926412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.926412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.926553] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.928024] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.928024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.928024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.928024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.928024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.928024] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.253180] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-640 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.253180] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.253180] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.253180] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.253180] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.253180] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.253180] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.254969] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.255303] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.255663] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.255937] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 979.256341] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 979.256611] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 979.257619] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.257619] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 979.257619] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 979.277240] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 979.277240] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 979.277240] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 979.277240] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.278031] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-cde4bdfe-a3cf-43be-8b5d-33949321e48e taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.278031] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-cde4bdfe-a3cf-43be-8b5d-33949321e48e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.278031] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-cde4bdfe-a3cf-43be-8b5d-33949321e48e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.278595] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-cde4bdfe-a3cf-43be-8b5d-33949321e48e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.279010] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cde4bdfe-a3cf-43be-8b5d-33949321e48e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.286811] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.431022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.431022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.431022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.431232] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.452215] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.452495] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.452615] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.452682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.452882] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.452967] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.453069] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf is going to be updated. [ 979.475477] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.475665] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.475699] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.475898] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.476055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.483241] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf in Status: IN_PROGRESS for 2s [ 979.781863] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.782057] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.782182] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.782479] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.782637] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.782833] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port cde4bdfe-a3cf-43be-8b5d-33949321e48e not found, creating... [ 979.783220] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.783498] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.783564] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.783821] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.783993] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.784441] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.784622] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.785508] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.785685] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.785792] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.786011] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: cde4bdfe-a3cf-43be-8b5d-33949321e48e is going to be created. [ 979.788656] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.805240] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.805240] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.805240] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.806030] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.806030] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.806248] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-cde4bdfe-a3cf-43be-8b5d-33949321e48e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.291833] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.292265] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.292265] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.292398] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.293078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.293078] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 980.323443] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.323443] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.323443] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.323443] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.323443] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.329125] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 980.348798] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f in Status: SUCCESS [ 980.349091] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.546043] env[69559]: INFO networking_nsxv3.common.synchronization [req-45e137b3-8fe0-425b-a952-425c58fd53dc req-c004ab42-3400-47da-8138-61b1715be323 service nova] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_rules [ 980.546448] env[69559]: INFO networking_nsxv3.common.synchronization [req-45e137b3-8fe0-425b-a952-425c58fd53dc req-c004ab42-3400-47da-8138-61b1715be323 service nova] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 980.546613] env[69559]: INFO networking_nsxv3.common.synchronization [req-45e137b3-8fe0-425b-a952-425c58fd53dc req-c004ab42-3400-47da-8138-61b1715be323 service nova] Enqueued Resource ID: cde4bdfe-a3cf-43be-8b5d-33949321e48e with Priority: HIGHEST for action port [ 980.547354] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_rules [ 980.547354] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 980.547431] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cde4bdfe-a3cf-43be-8b5d-33949321e48e with Priority: HIGHEST for action port [ 980.547658] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.547775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.547848] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.548145] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.548227] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.549162] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.552787] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.552787] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-cde4bdfe-a3cf-43be-8b5d-33949321e48e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.552787] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cde4bdfe-a3cf-43be-8b5d-33949321e48e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.552787] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cde4bdfe-a3cf-43be-8b5d-33949321e48e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.552787] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cde4bdfe-a3cf-43be-8b5d-33949321e48e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.552787] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cde4bdfe-a3cf-43be-8b5d-33949321e48e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.055561] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.055717] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.058014] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cde4bdfe-a3cf-43be-8b5d-33949321e48e with status ACTIVE [ 981.058014] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.058014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.058014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.058014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.058014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.058014] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.058014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.058014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.058014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.058014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.058014] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.058014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.058014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.058014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.058014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.058014] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cde4bdfe-a3cf-43be-8b5d-33949321e48e is going to be updated. [ 981.084104] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.084311] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.084311] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.084517] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.084650] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.084823] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cde4bdfe-a3cf-43be-8b5d-33949321e48e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.493033] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf in Status: SUCCESS [ 981.493033] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf deletion is rescheduled due to dependency. [ 981.493033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.337771] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 982.338221] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.338326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.338558] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.338807] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.338973] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.339058] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.341416] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.341416] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.341416] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.843137] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.345891] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.850795] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.851301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.851301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.851413] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.851479] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.851582] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 983.881056] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.881056] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.881056] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.881056] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.881056] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.891600] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 985.329301] env[69559]: INFO networking_nsxv3.common.synchronization [req-308b8415-7cd3-409a-9399-1b5955eb6022 req-038831a1-4288-4da7-9cb2-4478025db77c tempest-ImagesTestJSON-1150485476 tempest-ImagesTestJSON-1150485476-project-member] Enqueued Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 985.329914] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 985.330361] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.330644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.330644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.330857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.331603] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.332088] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.332088] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.332384] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.332656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.332762] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.514766] env[69559]: INFO networking_nsxv3.common.synchronization [req-7473060a-55ed-4d58-b68d-b4a68e390f90 req-1061a9a0-9166-485f-8f7d-d25053007b24 tempest-ListServersNegativeTestJSON-36957386 tempest-ListServersNegativeTestJSON-36957386-project-member] Enqueued Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_members [ 985.515383] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_members [ 985.515644] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.515766] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.515828] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.517336] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.517336] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.518135] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.518135] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.518408] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.518546] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.518703] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.838684] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.838684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.838684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.838684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.857496] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.857784] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.857912] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.857983] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.858212] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.858297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.858390] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 is going to be updated. [ 985.882066] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.882217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.882284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.882497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.883104] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.890094] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: IN_PROGRESS for 2s [ 985.898655] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 985.898794] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.898964] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.899800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.899800] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.899800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.899800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.899800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.899800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.900264] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.900264] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.988940] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-412 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.988940] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-412" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.988940] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-412" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.988940] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-412" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.989381] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.989381] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.989547] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.989804] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.989804] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.989804] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 985.989804] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.989804] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.990829] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.990829] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 985.990829] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.991955] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.010040] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.010040] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 986.010040] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.010040] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-412" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.010334] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-58c7918d-30bc-4e9b-8662-834228097ae7 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.013024] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-58c7918d-30bc-4e9b-8662-834228097ae7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.013024] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-58c7918d-30bc-4e9b-8662-834228097ae7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.013024] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-58c7918d-30bc-4e9b-8662-834228097ae7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.013024] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58c7918d-30bc-4e9b-8662-834228097ae7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.023609] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.023609] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.023609] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.023609] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.023609] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.023609] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.023957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.023957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.024814] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.024814] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.024991] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 already deleted. [ 986.024991] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.403531] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.404673] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.404673] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.404673] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.404673] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.404673] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.404673] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.404673] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.404673] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.404673] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.405065] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.405065] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.405065] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.405065] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.405204] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.405350] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.405350] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.405507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.405666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.405666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.405780] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.517310] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.517538] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.517704] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.518035] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.518204] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.518376] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 58c7918d-30bc-4e9b-8662-834228097ae7 not found, creating... [ 986.518674] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.518837] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.518962] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.519231] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.519374] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.519681] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.519949] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.520183] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.521669] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.521669] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.521669] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 58c7918d-30bc-4e9b-8662-834228097ae7 is going to be created. [ 986.543020] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.543020] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.543020] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.543020] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.543364] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.543637] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-58c7918d-30bc-4e9b-8662-834228097ae7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.910027] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebf5f404-8f48-487f-b212-72786dc389e8: rpc.has_security_group_logging(os_id): False [ 986.926045] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.926045] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.926045] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.926602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.943995] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.947422] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.947422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.947422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.947422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.947422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.947422] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.947422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.947422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.947422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.947422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.947422] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.947422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.947422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.947422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.948020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.948020] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 987.003017] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.006038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.006038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.006038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.006038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.019576] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 987.258041] env[69559]: INFO networking_nsxv3.common.synchronization [req-7473060a-55ed-4d58-b68d-b4a68e390f90 req-56e87289-2c46-4d20-9069-dd5e9a26977f service nova] Enqueued Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_rules [ 987.258041] env[69559]: INFO networking_nsxv3.common.synchronization [req-7473060a-55ed-4d58-b68d-b4a68e390f90 req-56e87289-2c46-4d20-9069-dd5e9a26977f service nova] Enqueued Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_members [ 987.258041] env[69559]: INFO networking_nsxv3.common.synchronization [req-7473060a-55ed-4d58-b68d-b4a68e390f90 req-56e87289-2c46-4d20-9069-dd5e9a26977f service nova] Enqueued Resource ID: 58c7918d-30bc-4e9b-8662-834228097ae7 with Priority: HIGHEST for action port [ 987.260067] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_rules [ 987.262106] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_members [ 987.262106] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58c7918d-30bc-4e9b-8662-834228097ae7 with Priority: HIGHEST for action port [ 987.262106] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.262106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.262106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.262106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.262106] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.263295] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.263481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.263530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.263815] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.263942] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.264106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.264195] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.264373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.264484] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.264597] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.265504] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-58c7918d-30bc-4e9b-8662-834228097ae7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.265624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58c7918d-30bc-4e9b-8662-834228097ae7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.265744] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58c7918d-30bc-4e9b-8662-834228097ae7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.265959] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58c7918d-30bc-4e9b-8662-834228097ae7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.266070] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58c7918d-30bc-4e9b-8662-834228097ae7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.769922] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.770512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.770870] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58c7918d-30bc-4e9b-8662-834228097ae7 with status ACTIVE [ 987.771238] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.771551] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.771721] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.772135] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.773105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.774257] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.774257] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.774257] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.774257] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.774257] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.774672] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.775069] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.775310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.778016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.778016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.778016] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58c7918d-30bc-4e9b-8662-834228097ae7 is going to be updated. [ 987.778016] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.799526] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.799668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.799668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.799819] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.800088] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.800263] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58c7918d-30bc-4e9b-8662-834228097ae7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.901755] env[69559]: INFO networking_nsxv3.common.synchronization [req-75eb906c-d267-4e2f-b746-8745ecd009d5 req-cb504667-6c70-40ca-8c84-74ef7fc4d9d6 tempest-ServersV294TestFqdnHostnames-516618000 tempest-ServersV294TestFqdnHostnames-516618000-project-member] Enqueued Resource ID: 67da4308-465f-4939-8941-41bacf52a39e with Priority: HIGHEST for action security_group_members [ 987.902637] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: SUCCESS [ 987.902820] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 deletion is rescheduled due to dependency. [ 987.902965] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.903471] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67da4308-465f-4939-8941-41bacf52a39e with Priority: HIGHEST for action security_group_members [ 987.903822] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-67da4308-465f-4939-8941-41bacf52a39e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.903958] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.904046] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.904260] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.904560] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.904637] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.904705] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.905722] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.905722] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.905722] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67da4308-465f-4939-8941-41bacf52a39e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.279729] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.408407] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.408754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.408754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.408872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.438019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.438019] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.438019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.438019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.438019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.438019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.438019] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67da4308-465f-4939-8941-41bacf52a39e is going to be updated. [ 988.446143] env[69559]: INFO networking_nsxv3.common.synchronization [req-7473060a-55ed-4d58-b68d-b4a68e390f90 req-e8ab2dee-be99-4c94-9c37-0381e9886a2a tempest-ListServersNegativeTestJSON-36957386 tempest-ListServersNegativeTestJSON-36957386-project-member] Enqueued Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_members [ 988.446143] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_members [ 988.446143] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.446143] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.466507] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.466507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.466507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.466507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.466507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.474971] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67da4308-465f-4939-8941-41bacf52a39e in Status: IN_PROGRESS for 2s [ 988.572201] env[69559]: INFO networking_nsxv3.common.synchronization [None req-3755ab0a-1550-4db1-9325-88aa8eff70d9 None None] Enqueued Resource ID: a19e03f4-85e5-43f9-b48a-2602dc6047ee with Priority: HIGHEST for action port [ 988.572201] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a19e03f4-85e5-43f9-b48a-2602dc6047ee with Priority: HIGHEST for action port [ 988.572201] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-a19e03f4-85e5-43f9-b48a-2602dc6047ee taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.572201] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a19e03f4-85e5-43f9-b48a-2602dc6047ee" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.572201] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a19e03f4-85e5-43f9-b48a-2602dc6047ee" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.572201] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a19e03f4-85e5-43f9-b48a-2602dc6047ee" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.572579] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a19e03f4-85e5-43f9-b48a-2602dc6047ee',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.783379] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.783379] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.783379] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.783379] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.783379] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.783379] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 is going to be created. [ 988.815752] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.815752] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.815752] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.815752] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.815752] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.835572] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: UNINITIALIZED for 2s [ 989.034116] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 989.034403] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.048994] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-412 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.048994] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-412" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.049233] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-412" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.049365] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-412" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.049654] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.049905] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.050497] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.050773] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.051412] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.051412] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 989.051412] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 989.052752] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 989.052752] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 989.052752] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 989.052752] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 989.052752] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 989.075168] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 989.075168] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 989.077505] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 989.077505] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-412" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.077505] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-df5d97ad-39ce-417b-9968-474fb4cfaa22 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.077505] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-df5d97ad-39ce-417b-9968-474fb4cfaa22" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.077505] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-df5d97ad-39ce-417b-9968-474fb4cfaa22" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.077505] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-df5d97ad-39ce-417b-9968-474fb4cfaa22" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.077505] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df5d97ad-39ce-417b-9968-474fb4cfaa22',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.078544] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a19e03f4-85e5-43f9-b48a-2602dc6047ee [ 989.078809] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.078978] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.079133] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.079401] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.079509] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.079615] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a19e03f4-85e5-43f9-b48a-2602dc6047ee already deleted. [ 989.079736] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a19e03f4-85e5-43f9-b48a-2602dc6047ee" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.584229] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.584629] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.584869] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.585316] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.585583] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.589021] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port df5d97ad-39ce-417b-9968-474fb4cfaa22 not found, creating... [ 989.589021] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.589021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.589021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.589021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.589021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.589021] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.589021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.589021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.589021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.589677] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.589976] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: df5d97ad-39ce-417b-9968-474fb4cfaa22 is going to be created. [ 989.620221] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.620221] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.620221] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.620221] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.620221] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.620483] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-df5d97ad-39ce-417b-9968-474fb4cfaa22" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.354836] env[69559]: INFO networking_nsxv3.common.synchronization [req-7473060a-55ed-4d58-b68d-b4a68e390f90 req-60849cd1-2507-4a24-bb0e-cfb46ea277e7 service nova] Enqueued Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_rules [ 990.355135] env[69559]: INFO networking_nsxv3.common.synchronization [req-7473060a-55ed-4d58-b68d-b4a68e390f90 req-60849cd1-2507-4a24-bb0e-cfb46ea277e7 service nova] Enqueued Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_members [ 990.355201] env[69559]: INFO networking_nsxv3.common.synchronization [req-7473060a-55ed-4d58-b68d-b4a68e390f90 req-60849cd1-2507-4a24-bb0e-cfb46ea277e7 service nova] Enqueued Resource ID: df5d97ad-39ce-417b-9968-474fb4cfaa22 with Priority: HIGHEST for action port [ 990.355693] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_rules [ 990.355830] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_members [ 990.357033] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df5d97ad-39ce-417b-9968-474fb4cfaa22 with Priority: HIGHEST for action port [ 990.357033] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.357033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.357033] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.357033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.357686] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-df5d97ad-39ce-417b-9968-474fb4cfaa22 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.357686] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df5d97ad-39ce-417b-9968-474fb4cfaa22" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.357686] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df5d97ad-39ce-417b-9968-474fb4cfaa22" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.358693] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df5d97ad-39ce-417b-9968-474fb4cfaa22" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.358693] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df5d97ad-39ce-417b-9968-474fb4cfaa22',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.383159] env[69559]: INFO networking_nsxv3.common.synchronization [None req-76d412ba-92b0-4c65-8822-3abb51e87e6f None None] Enqueued Resource ID: 4bcdf097-4bc2-4394-8b91-e1432e300e67 with Priority: HIGHEST for action port [ 990.383882] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bcdf097-4bc2-4394-8b91-e1432e300e67 with Priority: HIGHEST for action port [ 990.384139] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bcdf097-4bc2-4394-8b91-e1432e300e67 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.384594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bcdf097-4bc2-4394-8b91-e1432e300e67" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.384663] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bcdf097-4bc2-4394-8b91-e1432e300e67" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.384978] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bcdf097-4bc2-4394-8b91-e1432e300e67" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.385681] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bcdf097-4bc2-4394-8b91-e1432e300e67',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.484486] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67da4308-465f-4939-8941-41bacf52a39e in Status: SUCCESS [ 990.484678] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67da4308-465f-4939-8941-41bacf52a39e deletion is rescheduled due to dependency. [ 990.484795] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.840970] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: SUCCESS [ 990.841326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.841482] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.841768] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.841900] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.841969] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.842016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.843287] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.843287] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.843287] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.843287] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.848661] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.848661] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.848661] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.848661] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.848661] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.848661] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.848661] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.848661] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.861718] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df5d97ad-39ce-417b-9968-474fb4cfaa22 with status ACTIVE [ 990.862059] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.862207] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.862274] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.862471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.862555] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.862721] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.862814] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.862871] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.863087] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.863087] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.863795] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.863795] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.863795] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.863795] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.863795] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.863795] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df5d97ad-39ce-417b-9968-474fb4cfaa22 is going to be updated. [ 990.869850] env[69559]: INFO networking_nsxv3.common.synchronization [req-7473060a-55ed-4d58-b68d-b4a68e390f90 req-e4dfc0c4-c95d-4b9a-938e-b23f24aaf47e tempest-ListServersNegativeTestJSON-36957386 tempest-ListServersNegativeTestJSON-36957386-project-member] Enqueued Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_members [ 990.870448] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_members [ 990.870978] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.870978] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.886530] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.886670] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.887285] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.887285] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.887285] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.887285] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df5d97ad-39ce-417b-9968-474fb4cfaa22" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.887574] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4bcdf097-4bc2-4394-8b91-e1432e300e67 [ 990.888867] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.888867] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.889048] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.889297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.890333] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.890333] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4bcdf097-4bc2-4394-8b91-e1432e300e67 already deleted. [ 990.891067] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bcdf097-4bc2-4394-8b91-e1432e300e67" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.345919] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.346119] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.348483] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.426615] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-412 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.426912] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-412" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.427044] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-412" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.427750] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-412" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.428106] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.428281] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.428420] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.428650] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.428800] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.432082] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 991.432082] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 991.432082] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 991.432082] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 991.432082] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 991.432082] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 991.432082] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 991.450015] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 991.450364] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 991.451276] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 991.451276] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-412" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.452816] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-971022ba-169f-4f5a-afe9-161099dbbbcf taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.452816] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-971022ba-169f-4f5a-afe9-161099dbbbcf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.452816] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-971022ba-169f-4f5a-afe9-161099dbbbcf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.452816] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-971022ba-169f-4f5a-afe9-161099dbbbcf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.453105] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('971022ba-169f-4f5a-afe9-161099dbbbcf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.854144] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.956535] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.958097] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.958097] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.958097] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.958097] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.958097] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 971022ba-169f-4f5a-afe9-161099dbbbcf not found, creating... [ 991.958534] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.958534] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.958534] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.959033] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.959033] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.959277] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.959561] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.959687] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.959989] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.960169] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.960448] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 971022ba-169f-4f5a-afe9-161099dbbbcf is going to be created. [ 991.984419] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.984759] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.984967] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.985188] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.985440] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.985702] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-971022ba-169f-4f5a-afe9-161099dbbbcf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.357451] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.357643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.357706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.358513] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.358513] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.358513] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 is going to be updated. [ 992.383242] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.383439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.383504] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.383719] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.383861] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.393169] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: IN_PROGRESS for 2s [ 993.128257] env[69559]: INFO networking_nsxv3.common.synchronization [req-7473060a-55ed-4d58-b68d-b4a68e390f90 req-bae0210a-ce74-4acd-8e43-0e044d85fb6b service nova] Enqueued Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_rules [ 993.128548] env[69559]: INFO networking_nsxv3.common.synchronization [req-7473060a-55ed-4d58-b68d-b4a68e390f90 req-bae0210a-ce74-4acd-8e43-0e044d85fb6b service nova] Enqueued Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_members [ 993.128611] env[69559]: INFO networking_nsxv3.common.synchronization [req-7473060a-55ed-4d58-b68d-b4a68e390f90 req-bae0210a-ce74-4acd-8e43-0e044d85fb6b service nova] Enqueued Resource ID: 971022ba-169f-4f5a-afe9-161099dbbbcf with Priority: HIGHEST for action port [ 993.130035] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_rules [ 993.130035] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_members [ 993.130035] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 971022ba-169f-4f5a-afe9-161099dbbbcf with Priority: HIGHEST for action port [ 993.130035] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.130035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.130035] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.130035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.130562] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-971022ba-169f-4f5a-afe9-161099dbbbcf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.130562] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-971022ba-169f-4f5a-afe9-161099dbbbcf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.130562] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-971022ba-169f-4f5a-afe9-161099dbbbcf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.130698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-971022ba-169f-4f5a-afe9-161099dbbbcf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.130698] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('971022ba-169f-4f5a-afe9-161099dbbbcf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.409532] env[69559]: INFO networking_nsxv3.common.synchronization [req-ed83c054-b7c0-4b41-ada8-58235a051f30 req-94fc4b59-2eec-4ce6-a263-17f19db7e6bc tempest-DeleteServersTestJSON-1423597435 tempest-DeleteServersTestJSON-1423597435-project-member] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 993.414024] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 993.414024] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.414024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.414024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.414024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.414024] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.414024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.414024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.414024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.414024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.414024] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.426955] env[69559]: INFO networking_nsxv3.common.synchronization [req-bcb0d75a-a592-4e2f-8543-ce6d6c4a6abc req-235cb4c0-e11e-4136-af55-a868cd9f5d5e tempest-ServersTestJSON-514909010 tempest-ServersTestJSON-514909010-project-member] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 993.427697] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 993.427940] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.428077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.428143] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.428397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.428484] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.428573] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.428630] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.428774] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.428850] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.428942] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.633094] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 971022ba-169f-4f5a-afe9-161099dbbbcf with status ACTIVE [ 993.633447] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.633531] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.633573] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.633771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.633860] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.634068] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.634180] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.634245] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.634440] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.634440] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.634635] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.634727] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.634783] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.634919] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.634993] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.635089] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 971022ba-169f-4f5a-afe9-161099dbbbcf is going to be updated. [ 993.655121] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.655260] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.655333] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.655532] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.655726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.655911] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-971022ba-169f-4f5a-afe9-161099dbbbcf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.823963] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-596 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.824200] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.824360] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.824646] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.824992] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.825227] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.825394] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.825818] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.825909] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.826083] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.826208] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.826329] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.826461] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.826589] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.826704] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.826842] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.845977] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.846185] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 993.846314] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.846539] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.846871] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-e4cacab6-8816-4ccb-9d28-45c1924f7081 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.847072] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-e4cacab6-8816-4ccb-9d28-45c1924f7081" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.847205] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-e4cacab6-8816-4ccb-9d28-45c1924f7081" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.847603] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-e4cacab6-8816-4ccb-9d28-45c1924f7081" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.847727] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4cacab6-8816-4ccb-9d28-45c1924f7081',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.914523] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.915217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.915217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.915217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.915217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.915456] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.915456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.915456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.915618] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.915661] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.915740] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be updated. [ 993.930702] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.941418] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.941927] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.941927] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.941927] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.941927] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.950467] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 994.350516] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.350969] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.350969] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.351156] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.351272] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.351447] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port e4cacab6-8816-4ccb-9d28-45c1924f7081 not found, creating... [ 994.351713] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.351877] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.352008] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.352282] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.352442] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.352733] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.352893] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.353150] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.353400] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.353545] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.353694] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: e4cacab6-8816-4ccb-9d28-45c1924f7081 is going to be created. [ 994.373407] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.373649] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.373782] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.374070] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.374311] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.374544] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-e4cacab6-8816-4ccb-9d28-45c1924f7081" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.401763] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: SUCCESS [ 994.401993] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.402298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.402459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.402657] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.402788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.402858] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.403129] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.403129] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.403246] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.433372] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.906616] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.935892] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.936062] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.936164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.936350] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.936446] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.936533] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 994.964438] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.964601] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.964654] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.964858] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.964999] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.974922] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 995.299880] env[69559]: INFO networking_nsxv3.common.synchronization [req-ed83c054-b7c0-4b41-ada8-58235a051f30 req-7436dac7-82f6-4c46-946c-f6800a0e7edf service nova] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_rules [ 995.300098] env[69559]: INFO networking_nsxv3.common.synchronization [req-ed83c054-b7c0-4b41-ada8-58235a051f30 req-7436dac7-82f6-4c46-946c-f6800a0e7edf service nova] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 995.300308] env[69559]: INFO networking_nsxv3.common.synchronization [req-ed83c054-b7c0-4b41-ada8-58235a051f30 req-7436dac7-82f6-4c46-946c-f6800a0e7edf service nova] Enqueued Resource ID: e4cacab6-8816-4ccb-9d28-45c1924f7081 with Priority: HIGHEST for action port [ 995.302856] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_rules [ 995.302856] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 995.302856] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4cacab6-8816-4ccb-9d28-45c1924f7081 with Priority: HIGHEST for action port [ 995.302856] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.302856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.302856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.302856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.302856] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.303202] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.303857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.303857] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4cacab6-8816-4ccb-9d28-45c1924f7081 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.303857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4cacab6-8816-4ccb-9d28-45c1924f7081" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.303857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4cacab6-8816-4ccb-9d28-45c1924f7081" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.304208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4cacab6-8816-4ccb-9d28-45c1924f7081" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.304208] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4cacab6-8816-4ccb-9d28-45c1924f7081',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.409391] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.806566] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.806700] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.810206] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4cacab6-8816-4ccb-9d28-45c1924f7081 with status ACTIVE [ 995.810535] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.810697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.810771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.811286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.811286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.811713] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.811713] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.811713] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.811849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.811901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.812180] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.812293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.812347] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.812495] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.812575] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.812658] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4cacab6-8816-4ccb-9d28-45c1924f7081 is going to be updated. [ 995.832586] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.832586] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.832586] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.832880] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.832880] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.832961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4cacab6-8816-4ccb-9d28-45c1924f7081" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.913242] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.913242] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.913242] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.913242] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.913242] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.913242] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 is going to be updated. [ 995.940167] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.940588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.940588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.940839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.941084] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.956274] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: IN_PROGRESS for 2s [ 995.959963] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 995.961086] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d deletion is rescheduled due to dependency. [ 995.961234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.961399] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.961696] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.961931] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.962078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.962196] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.962385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.962475] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.962572] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.465060] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.921705] env[69559]: INFO networking_nsxv3.common.synchronization [req-d2722fd3-929a-44f4-bfee-7838ce25e6ae req-0cfd7764-a4ce-4379-92b6-70dd5ebe5010 tempest-ServerMetadataNegativeTestJSON-1411965612 tempest-ServerMetadataNegativeTestJSON-1411965612-project-member] Enqueued Resource ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 with Priority: HIGHEST for action security_group_members [ 996.922844] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 with Priority: HIGHEST for action security_group_members [ 996.922844] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.922844] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.922844] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.923109] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.923278] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.923383] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.923443] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.923591] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.923672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.923760] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('233eac4d-0cf7-44e3-b0cf-9c09c50ed577',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.969521] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.990034] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 996.990034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.414890] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-745 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.415091] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-745" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.415199] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-745" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.415551] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-745" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.415825] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.416012] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.416163] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.416452] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.416610] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.416834] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 997.416946] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 997.417072] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 997.417296] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 997.417378] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 997.417455] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 997.417604] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 997.429808] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.430101] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.430101] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.430254] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.430345] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.430539] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.430679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.430744] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.430900] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.430995] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.431098] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 already deleted. [ 997.431184] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.451568] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 997.451772] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 997.452076] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 997.452323] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-745" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.452654] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-d935d456-5696-49df-88c2-7ac87a5251ee taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.452836] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-d935d456-5696-49df-88c2-7ac87a5251ee" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.452964] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-d935d456-5696-49df-88c2-7ac87a5251ee" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.453371] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-d935d456-5696-49df-88c2-7ac87a5251ee" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.453600] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d935d456-5696-49df-88c2-7ac87a5251ee',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.473090] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.473090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.473090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.473090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.473090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.473090] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be updated. [ 997.512694] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.512922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.512922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.513138] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.513288] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.522223] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 997.956617] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.956617] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.956870] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.957266] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.957541] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.957913] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port d935d456-5696-49df-88c2-7ac87a5251ee not found, creating... [ 997.958322] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.958619] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.964154] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.964154] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.964154] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.964154] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.964154] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.964154] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.964154] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.964154] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.964154] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: d935d456-5696-49df-88c2-7ac87a5251ee is going to be created. [ 997.970464] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: SUCCESS [ 997.970727] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.970897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.971175] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.971397] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.971538] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.971610] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.971770] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.971851] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.971950] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.980216] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.980216] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.980216] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.980428] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.980614] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.980896] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-d935d456-5696-49df-88c2-7ac87a5251ee" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.477187] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.781449] env[69559]: INFO networking_nsxv3.common.synchronization [req-d2722fd3-929a-44f4-bfee-7838ce25e6ae req-875edbdb-6bd1-48db-b533-f00a1c832d4c service nova] Enqueued Resource ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 with Priority: HIGHEST for action security_group_rules [ 998.781651] env[69559]: INFO networking_nsxv3.common.synchronization [req-d2722fd3-929a-44f4-bfee-7838ce25e6ae req-875edbdb-6bd1-48db-b533-f00a1c832d4c service nova] Enqueued Resource ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 with Priority: HIGHEST for action security_group_members [ 998.781792] env[69559]: INFO networking_nsxv3.common.synchronization [req-d2722fd3-929a-44f4-bfee-7838ce25e6ae req-875edbdb-6bd1-48db-b533-f00a1c832d4c service nova] Enqueued Resource ID: d935d456-5696-49df-88c2-7ac87a5251ee with Priority: HIGHEST for action port [ 998.782481] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 with Priority: HIGHEST for action security_group_rules [ 998.782544] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 with Priority: HIGHEST for action security_group_members [ 998.782648] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d935d456-5696-49df-88c2-7ac87a5251ee with Priority: HIGHEST for action port [ 998.782944] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-233eac4d-0cf7-44e3-b0cf-9c09c50ed577 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.785338] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.785338] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.785338] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.785541] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('233eac4d-0cf7-44e3-b0cf-9c09c50ed577',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.786418] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.786542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.786745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.786826] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.787240] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.787240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.787240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.787447] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.787447] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.787447] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('233eac4d-0cf7-44e3-b0cf-9c09c50ed577',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.788695] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-d935d456-5696-49df-88c2-7ac87a5251ee taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.788842] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d935d456-5696-49df-88c2-7ac87a5251ee" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.788910] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d935d456-5696-49df-88c2-7ac87a5251ee" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.789068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d935d456-5696-49df-88c2-7ac87a5251ee" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.789145] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d935d456-5696-49df-88c2-7ac87a5251ee',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.978879] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.291297] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.291969] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.291969] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('233eac4d-0cf7-44e3-b0cf-9c09c50ed577',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.292654] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d935d456-5696-49df-88c2-7ac87a5251ee with status ACTIVE [ 999.295019] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.295019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.295019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.295019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.295019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.295019] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.295019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.295019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.295019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.295019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.297967] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.298292] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.298383] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.298771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.298868] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.299642] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d935d456-5696-49df-88c2-7ac87a5251ee is going to be updated. [ 999.322595] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.322925] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.323139] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.324035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.324035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.324035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d935d456-5696-49df-88c2-7ac87a5251ee" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.481868] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.482208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.482208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.482910] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.482910] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.483261] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 is going to be updated. [ 999.510675] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.510840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.510979] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.511194] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.511382] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.521846] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: IN_PROGRESS for 2s [ 999.530090] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 999.530326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.530488] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.531311] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.531311] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.531311] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.531311] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.531311] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.531311] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.531577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.531577] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.697592] env[69559]: INFO networking_nsxv3.common.synchronization [None req-10e4fd90-d4fb-41d7-8a03-883bf7c68ce6 tempest-ServerActionsTestOtherA-1414477814 tempest-ServerActionsTestOtherA-1414477814-project-member] Enqueued Resource ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 with Priority: HIGHEST for action security_group_rules [ 999.697808] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 with Priority: HIGHEST for action security_group_rules [ 999.698552] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.698721] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.698797] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.699018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.699103] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.804149] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('233eac4d-0cf7-44e3-b0cf-9c09c50ed577',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.809696] env[69559]: INFO networking_nsxv3.common.synchronization [None req-2c6145f6-d61c-4fd3-9988-228e790dbf1b tempest-ServerActionsTestOtherA-1414477814 tempest-ServerActionsTestOtherA-1414477814-project-member] Enqueued Resource ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 with Priority: HIGHEST for action security_group_rules [ 999.811017] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 with Priority: HIGHEST for action security_group_rules [ 999.811017] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.811017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.033370] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.035134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.036122] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.036122] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.036122] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.036122] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.036122] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.036641] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.036830] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.037034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.037304] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.037521] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.038561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.038561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.038561] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.038561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.038561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.038561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.038937] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.040079] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.040313] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.233835] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.233835] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.233835] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.233835] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.233835] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.233835] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 already deleted. [ 1000.233835] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.233835] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.233835] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.233835] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.313025] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.313025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.313025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.313025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.313025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.313025] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 is going to be created. [ 1000.331860] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.332041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.332097] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.332303] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.332503] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.341324] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 in Status: UNINITIALIZED for 2s [ 1000.543189] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 839ae40b-5f13-4259-8e2a-b943b206557d: rpc.has_security_group_logging(os_id): False [ 1000.560969] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.561200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.561288] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.561502] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.561597] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.561819] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.561915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.561977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.562140] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.562216] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.562427] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.562671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.562671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.562776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.562776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.562947] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.563043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.563099] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.563233] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.563316] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.563386] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be updated. [ 1000.617107] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.618471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.618471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.618471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.618471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.630304] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 1000.762568] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.762568] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.762759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.763360] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.763360] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.763360] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 already deleted. [ 1000.763360] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.483760] env[69559]: INFO networking_nsxv3.common.synchronization [req-2765c410-8f93-4210-94c3-355e3f89a97d req-925b9e9e-982c-4643-95a1-c5c283f1ebb4 tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 868ef973-ca6a-480b-be75-839232b752db with Priority: HIGHEST for action security_group_members [ 1001.484427] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 868ef973-ca6a-480b-be75-839232b752db with Priority: HIGHEST for action security_group_members [ 1001.484798] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-868ef973-ca6a-480b-be75-839232b752db taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.484944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.485023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.485308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.485475] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.485923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.485923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.485923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.485923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.486111] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('868ef973-ca6a-480b-be75-839232b752db',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.533715] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: SUCCESS [ 1001.534054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.534309] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.534555] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.534775] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.534950] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.535077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.535273] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.535402] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.535487] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.535734] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.535837] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.535938] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.538230] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.538424] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.538559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.538636] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.538771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.538849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.538935] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.539043] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.540035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.540035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.543690] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.544014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.544014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.544145] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.544194] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.544310] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.956136] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.956136] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.956136] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.956136] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.956805] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.961023] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.961023] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.961023] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.961023] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.961023] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1001.961023] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1001.961023] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1001.961023] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1001.961023] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1001.961023] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1001.961023] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1001.981021] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1001.981021] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1001.981021] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1001.981021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.981021] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-deb8bc51-c198-41de-85d4-0b5811c3c46c taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.981021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-deb8bc51-c198-41de-85d4-0b5811c3c46c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.981021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-deb8bc51-c198-41de-85d4-0b5811c3c46c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.981021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-deb8bc51-c198-41de-85d4-0b5811c3c46c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.981021] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('deb8bc51-c198-41de-85d4-0b5811c3c46c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.987848] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.988107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.988190] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.990034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.990034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.990034] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.990034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.990034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.990034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.990034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.990034] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 868ef973-ca6a-480b-be75-839232b752db already deleted. [ 1001.990034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.049041] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9b79819-0a51-4cc6-8e3e-f823f0b89406: rpc.has_security_group_logging(os_id): False [ 1002.050200] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.068399] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.068608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.068608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.068910] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.069049] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.069314] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.069439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.069516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.069680] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.069794] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.070077] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.070192] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.073129] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.073129] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.073129] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.073129] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.073129] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.073129] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.073129] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.073129] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.073129] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 is going to be created. [ 1002.124141] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.128134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.128134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.128134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.128134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.134719] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: IN_PROGRESS for 2s [ 1002.321809] env[69559]: INFO networking_nsxv3.common.synchronization [req-607373d2-9962-40c9-8abc-d5e1cb8a18ba req-25a0a0dc-b7a4-46c7-a807-49f55b4a7770 tempest-AttachVolumeNegativeTest-1400300488 tempest-AttachVolumeNegativeTest-1400300488-project-member] Enqueued Resource ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 with Priority: HIGHEST for action security_group_members [ 1002.322659] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 with Priority: HIGHEST for action security_group_members [ 1002.322819] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.322953] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.323040] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.323232] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.323388] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.323802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.323876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.324036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.324124] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.324217] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bb1158b-fef7-4aa2-82e3-14d38a93d9b2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.349937] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 in Status: SUCCESS [ 1002.350192] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.350726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.350807] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.350998] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.351169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.351240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.351401] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.351481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.351567] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.351653] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('233eac4d-0cf7-44e3-b0cf-9c09c50ed577',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.485944] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.486208] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.486360] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.486645] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.486805] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.486965] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port deb8bc51-c198-41de-85d4-0b5811c3c46c not found, creating... [ 1002.487321] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.487407] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.487579] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.487742] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.487916] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.488180] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.488341] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.488529] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.488768] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.488909] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.489066] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: deb8bc51-c198-41de-85d4-0b5811c3c46c is going to be created. [ 1002.508719] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.508863] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.508927] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.509269] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.509478] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.509728] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-deb8bc51-c198-41de-85d4-0b5811c3c46c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.555352] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.644448] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 1002.644698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.826834] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.827059] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.827139] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.827417] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.827540] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.827812] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.827943] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.828020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.828205] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.828286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.828385] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 is going to be updated. [ 1002.854095] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.854363] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.854363] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.854621] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.854706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.855854] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.855984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.856064] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.856210] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.856343] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.856425] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.856487] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.856623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.856702] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.856783] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.856924] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.857030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.857086] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.857219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.857349] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.857438] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.857499] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.857618] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.857686] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.857764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.857847] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('233eac4d-0cf7-44e3-b0cf-9c09c50ed577',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.865847] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 in Status: IN_PROGRESS for 2s [ 1003.056984] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.057181] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.057245] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.057461] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.057553] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.057654] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 is going to be updated. [ 1003.085502] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.085692] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.085760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.085964] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.086121] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.093998] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: IN_PROGRESS for 2s [ 1003.360354] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 233eac4d-0cf7-44e3-b0cf-9c09c50ed577: rpc.has_security_group_logging(os_id): False [ 1003.378774] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.378998] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.379097] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.379385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.379479] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.379684] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.379784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.379847] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.380015] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.380109] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.380299] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.380423] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.380486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.380629] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.380703] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.380912] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.381149] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.381243] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.381437] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.381512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.381600] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 is going to be created. [ 1003.450946] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.451142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.451227] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.451442] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.451642] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.462387] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 in Status: IN_PROGRESS for 2s [ 1003.471672] env[69559]: INFO networking_nsxv3.common.synchronization [req-2765c410-8f93-4210-94c3-355e3f89a97d req-24f205e3-80a0-4265-b2a1-1b7013bb2a17 service nova] Enqueued Resource ID: 868ef973-ca6a-480b-be75-839232b752db with Priority: HIGHEST for action security_group_rules [ 1003.471834] env[69559]: INFO networking_nsxv3.common.synchronization [req-2765c410-8f93-4210-94c3-355e3f89a97d req-24f205e3-80a0-4265-b2a1-1b7013bb2a17 service nova] Enqueued Resource ID: 868ef973-ca6a-480b-be75-839232b752db with Priority: HIGHEST for action security_group_members [ 1003.471990] env[69559]: INFO networking_nsxv3.common.synchronization [req-2765c410-8f93-4210-94c3-355e3f89a97d req-24f205e3-80a0-4265-b2a1-1b7013bb2a17 service nova] Enqueued Resource ID: deb8bc51-c198-41de-85d4-0b5811c3c46c with Priority: HIGHEST for action port [ 1003.472237] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 868ef973-ca6a-480b-be75-839232b752db with Priority: HIGHEST for action security_group_rules [ 1003.472385] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 868ef973-ca6a-480b-be75-839232b752db with Priority: HIGHEST for action security_group_members [ 1003.472502] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deb8bc51-c198-41de-85d4-0b5811c3c46c with Priority: HIGHEST for action port [ 1003.473118] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-868ef973-ca6a-480b-be75-839232b752db taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.473262] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.473331] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.473552] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.473695] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('868ef973-ca6a-480b-be75-839232b752db',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.474512] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-868ef973-ca6a-480b-be75-839232b752db taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.474641] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.474709] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.474890] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.475044] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.475143] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.475203] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.475364] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.475463] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.475565] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('868ef973-ca6a-480b-be75-839232b752db',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.476395] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-deb8bc51-c198-41de-85d4-0b5811c3c46c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.476508] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-deb8bc51-c198-41de-85d4-0b5811c3c46c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.476617] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-deb8bc51-c198-41de-85d4-0b5811c3c46c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.476876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-deb8bc51-c198-41de-85d4-0b5811c3c46c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.477367] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('deb8bc51-c198-41de-85d4-0b5811c3c46c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.980282] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-868ef973-ca6a-480b-be75-839232b752db taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.980823] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.981053] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('868ef973-ca6a-480b-be75-839232b752db',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.982798] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port deb8bc51-c198-41de-85d4-0b5811c3c46c with status ACTIVE [ 1003.983989] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.983989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.983989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.983989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.983989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.983989] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.983989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.983989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.983989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.983989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.984420] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.984420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.984420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.984420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.984552] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.984552] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: deb8bc51-c198-41de-85d4-0b5811c3c46c is going to be updated. [ 1004.003684] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.003840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.003878] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.004103] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.004232] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.004383] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-deb8bc51-c198-41de-85d4-0b5811c3c46c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.039377] env[69559]: INFO networking_nsxv3.common.synchronization [req-20f71a07-118e-426f-92ef-6f2f76f14db0 req-cf573cd9-8d0f-4da3-8971-23d19928b91b tempest-AttachInterfacesV270Test-2057930510 tempest-AttachInterfacesV270Test-2057930510-project-member] Enqueued Resource ID: 51f74e50-136f-49a9-8456-6841ae996220 with Priority: HIGHEST for action security_group_members [ 1004.039377] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51f74e50-136f-49a9-8456-6841ae996220 with Priority: HIGHEST for action security_group_members [ 1004.040144] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-51f74e50-136f-49a9-8456-6841ae996220 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.040495] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.041319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.041319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.041319] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.041319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.041319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.042501] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.042501] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.042501] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51f74e50-136f-49a9-8456-6841ae996220',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.147427] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: SUCCESS [ 1004.147427] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.147427] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.147427] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.147427] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.484728] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('868ef973-ca6a-480b-be75-839232b752db',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.545775] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.545775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.545775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.545775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.545775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.545775] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.545775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.545775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.545775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.545775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.545775] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51f74e50-136f-49a9-8456-6841ae996220 already deleted. [ 1004.545775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.648998] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.649150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.874790] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 in Status: SUCCESS [ 1004.875088] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 deletion is rescheduled due to dependency. [ 1004.875173] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.952582] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.952852] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-829" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.953029] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-829" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.953400] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-829" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.953720] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.953924] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.954095] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.954366] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.954558] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.954803] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1004.955375] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.955375] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.955375] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.955375] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1004.955552] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.955663] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.972302] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.972470] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1004.972618] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.972844] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-829" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.973215] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-d7a63407-0f53-4bff-a33b-7e44df395564 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.973389] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-d7a63407-0f53-4bff-a33b-7e44df395564" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.973513] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-d7a63407-0f53-4bff-a33b-7e44df395564" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.973800] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-d7a63407-0f53-4bff-a33b-7e44df395564" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.973942] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7a63407-0f53-4bff-a33b-7e44df395564',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.986451] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.986699] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.986699] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.986850] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.986946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.987047] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 868ef973-ca6a-480b-be75-839232b752db is going to be created. [ 1005.011947] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.012146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.012212] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.012403] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.012559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.021392] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 868ef973-ca6a-480b-be75-839232b752db in Status: UNINITIALIZED for 2s [ 1005.103357] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: SUCCESS [ 1005.103569] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.104164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.104164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.104164] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.105053] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.105149] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.105349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.105421] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.105469] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.105559] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.474044] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 in Status: SUCCESS [ 1005.474044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.476907] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.477095] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.477189] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.477711] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.477976] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.478178] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port d7a63407-0f53-4bff-a33b-7e44df395564 not found, creating... [ 1005.478487] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.478659] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.478787] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.479056] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.479242] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.479625] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.479851] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.479997] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.480285] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.480436] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.480616] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: d7a63407-0f53-4bff-a33b-7e44df395564 is going to be created. [ 1005.498803] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.498998] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.499303] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.499449] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.499856] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.500171] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-d7a63407-0f53-4bff-a33b-7e44df395564" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.607480] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.607678] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.607743] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.607993] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.608444] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.608444] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.608444] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.608675] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.608727] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.608783] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.609191] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.609191] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.609191] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.609511] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.609592] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.610562] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.610562] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.610562] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.610562] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.610562] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.610562] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.115416] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9b79819-0a51-4cc6-8e3e-f823f0b89406: rpc.has_security_group_logging(os_id): False [ 1006.136746] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.136746] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.136746] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.136746] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.136746] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.136746] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.136746] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.136746] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.136746] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.136746] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.140240] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.140240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.140240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.140240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.140240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.140240] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.140240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.140240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.140240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.140240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.140240] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 is going to be updated. [ 1006.226974] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.226974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.226974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.226974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.226974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.238967] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: IN_PROGRESS for 2s [ 1006.287678] env[69559]: INFO networking_nsxv3.common.synchronization [req-20f71a07-118e-426f-92ef-6f2f76f14db0 req-48a150ae-8bc1-47d3-9ba2-40072d00a67e service nova] Enqueued Resource ID: 51f74e50-136f-49a9-8456-6841ae996220 with Priority: HIGHEST for action security_group_rules [ 1006.287678] env[69559]: INFO networking_nsxv3.common.synchronization [req-20f71a07-118e-426f-92ef-6f2f76f14db0 req-48a150ae-8bc1-47d3-9ba2-40072d00a67e service nova] Enqueued Resource ID: 51f74e50-136f-49a9-8456-6841ae996220 with Priority: HIGHEST for action security_group_members [ 1006.287678] env[69559]: INFO networking_nsxv3.common.synchronization [req-20f71a07-118e-426f-92ef-6f2f76f14db0 req-48a150ae-8bc1-47d3-9ba2-40072d00a67e service nova] Enqueued Resource ID: d7a63407-0f53-4bff-a33b-7e44df395564 with Priority: HIGHEST for action port [ 1006.287678] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51f74e50-136f-49a9-8456-6841ae996220 with Priority: HIGHEST for action security_group_rules [ 1006.287932] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51f74e50-136f-49a9-8456-6841ae996220 with Priority: HIGHEST for action security_group_members [ 1006.287932] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7a63407-0f53-4bff-a33b-7e44df395564 with Priority: HIGHEST for action port [ 1006.289072] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51f74e50-136f-49a9-8456-6841ae996220 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.289199] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.289199] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.289421] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.289521] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51f74e50-136f-49a9-8456-6841ae996220',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.290884] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-51f74e50-136f-49a9-8456-6841ae996220 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.291236] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.291236] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.291352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.291515] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.291625] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.291701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.291845] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.291930] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.292447] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51f74e50-136f-49a9-8456-6841ae996220',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.292788] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7a63407-0f53-4bff-a33b-7e44df395564 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.296060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7a63407-0f53-4bff-a33b-7e44df395564" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.296149] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7a63407-0f53-4bff-a33b-7e44df395564" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.296335] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7a63407-0f53-4bff-a33b-7e44df395564" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.296416] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7a63407-0f53-4bff-a33b-7e44df395564',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.798403] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51f74e50-136f-49a9-8456-6841ae996220',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.799624] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-51f74e50-136f-49a9-8456-6841ae996220 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.800414] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.800414] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7a63407-0f53-4bff-a33b-7e44df395564 with status ACTIVE [ 1006.800414] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.800660] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.800660] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.803157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.803157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.803157] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.803157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.803157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.803157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.803157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.803157] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.803157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.803157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.803157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.803157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.803157] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7a63407-0f53-4bff-a33b-7e44df395564 is going to be updated. [ 1006.825125] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.825302] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.825420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.825639] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.825796] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.825965] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7a63407-0f53-4bff-a33b-7e44df395564" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.031774] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 868ef973-ca6a-480b-be75-839232b752db in Status: SUCCESS [ 1007.032053] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.032255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.032530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.032774] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.032928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.033009] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.033265] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.033308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.033386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.033528] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('868ef973-ca6a-480b-be75-839232b752db',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.106080] env[69559]: INFO networking_nsxv3.common.synchronization [req-a62d0ae1-fe06-4298-9eca-e1e18655e6a5 req-5d5c8a96-707e-464c-8206-cf25d114d966 tempest-ListServersNegativeTestJSON-36957386 tempest-ListServersNegativeTestJSON-36957386-project-member] Enqueued Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_members [ 1007.106692] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_members [ 1007.109181] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.109181] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.109181] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.109181] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.109527] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.109527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.109527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.109643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.109687] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.110114] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.301592] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51f74e50-136f-49a9-8456-6841ae996220',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.537958] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('868ef973-ca6a-480b-be75-839232b752db',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.613621] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.804308] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.804616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.804616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.804860] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.804987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.805109] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51f74e50-136f-49a9-8456-6841ae996220 is going to be created. [ 1007.830252] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.831319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.831319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.831319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.831883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.841077] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51f74e50-136f-49a9-8456-6841ae996220 in Status: UNINITIALIZED for 2s [ 1008.041728] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 868ef973-ca6a-480b-be75-839232b752db: rpc.has_security_group_logging(os_id): False [ 1008.063031] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.063031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.063031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.063031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.063031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.063031] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.063031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.063031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.063031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.063031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.063031] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 868ef973-ca6a-480b-be75-839232b752db is going to be created. [ 1008.116528] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.137628] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.137831] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.137948] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.138262] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.138511] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.156783] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 868ef973-ca6a-480b-be75-839232b752db in Status: IN_PROGRESS for 2s [ 1008.257430] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: SUCCESS [ 1008.257430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.257430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.257430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.257430] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.619280] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.619683] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.619683] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.619949] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.620539] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.620737] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 is going to be updated. [ 1008.649507] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.649507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.649507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.649673] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.649799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.658598] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: IN_PROGRESS for 2s [ 1008.759421] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.759657] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.304240] env[69559]: INFO networking_nsxv3.common.synchronization [req-6ed5dd52-3b45-4cca-bba3-571df4880b40 req-362482ba-7124-4875-b218-70e4f2588572 tempest-ImagesTestJSON-1150485476 tempest-ImagesTestJSON-1150485476-project-member] Enqueued Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 1009.304790] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 1009.305036] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.305728] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.305800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.306011] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.306181] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.306281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.306355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.306491] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.306575] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.306666] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.632794] env[69559]: INFO networking_nsxv3.common.synchronization [req-1042df97-5525-48ef-8e70-3ad4443689ee req-d3944cce-de29-4169-95ea-958c8d0161f3 tempest-DeleteServersTestJSON-1423597435 tempest-DeleteServersTestJSON-1423597435-project-member] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 1009.633633] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 1009.635119] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.635119] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.635347] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.635559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.635723] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.635824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.635887] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.636326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.636326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.636326] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.760025] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-190 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.760025] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-190" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.760025] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-190" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.760025] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-190" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.760025] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.760025] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.760025] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.760025] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.760025] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.760701] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1009.760701] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.760701] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.760701] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.760847] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1009.760968] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.761119] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.780460] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.780715] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1009.780871] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.781134] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-190" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.781586] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-87ee45ac-85ac-4537-af2c-85c696caa4ac taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.781844] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-87ee45ac-85ac-4537-af2c-85c696caa4ac" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.782019] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-87ee45ac-85ac-4537-af2c-85c696caa4ac" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.782421] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-87ee45ac-85ac-4537-af2c-85c696caa4ac" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.782733] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87ee45ac-85ac-4537-af2c-85c696caa4ac',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.808967] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.809255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.809255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.809411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.809507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.809709] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.809808] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.809863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.810123] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.810285] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.810285] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 is going to be updated. [ 1009.843686] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.843953] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.843953] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.844171] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.844315] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.854067] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: IN_PROGRESS for 2s [ 1009.854439] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51f74e50-136f-49a9-8456-6841ae996220 in Status: SUCCESS [ 1009.854667] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.854897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.855161] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.855340] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.855465] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.855563] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.855670] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.855742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.855804] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.855893] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('51f74e50-136f-49a9-8456-6841ae996220',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.138852] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.138852] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.138852] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.139091] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.139091] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.139258] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.139355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.139429] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.139581] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.139671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.139759] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be updated. [ 1010.171621] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 868ef973-ca6a-480b-be75-839232b752db in Status: SUCCESS [ 1010.171849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.191950] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.192124] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.192196] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.192426] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.192576] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.209483] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 1010.285825] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.286801] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.286801] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.286801] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.286801] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.286801] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 87ee45ac-85ac-4537-af2c-85c696caa4ac not found, creating... [ 1010.287086] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.287219] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.288880] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.288880] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.288880] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.288880] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.288880] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.288880] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.288880] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.288880] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.288880] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 87ee45ac-85ac-4537-af2c-85c696caa4ac is going to be created. [ 1010.311317] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.311566] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.311700] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.311983] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.312237] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.312516] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-87ee45ac-85ac-4537-af2c-85c696caa4ac" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.359195] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-51f74e50-136f-49a9-8456-6841ae996220 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.359195] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.359195] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.359195] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.359195] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.359595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.359595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.359595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.359719] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.359756] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.359906] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-51f74e50-136f-49a9-8456-6841ae996220 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.360009] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.360102] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.360271] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.360415] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.360520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.360596] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.360741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.360831] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.360924] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.361017] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('51f74e50-136f-49a9-8456-6841ae996220',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.668514] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: SUCCESS [ 1010.668828] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.668891] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.669176] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.669376] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.669497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.669556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.669710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.669789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.669886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.669975] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.863653] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 51f74e50-136f-49a9-8456-6841ae996220: rpc.has_security_group_logging(os_id): False [ 1010.891328] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.891328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.891328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.891328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.891328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.891328] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.891328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.891328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.891328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.891328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.891328] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.891328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.891328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.891328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.891328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.893550] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.895582] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.895582] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.895582] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.895582] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.895582] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51f74e50-136f-49a9-8456-6841ae996220 is going to be created. [ 1010.952840] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.952840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.952840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.952840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.952840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.961792] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51f74e50-136f-49a9-8456-6841ae996220 in Status: IN_PROGRESS for 2s [ 1011.173270] env[69559]: INFO networking_nsxv3.common.synchronization [req-6ed5dd52-3b45-4cca-bba3-571df4880b40 req-4466cf43-c831-4c62-8602-f29a54a9ad5f service nova] Enqueued Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_rules [ 1011.173882] env[69559]: INFO networking_nsxv3.common.synchronization [req-6ed5dd52-3b45-4cca-bba3-571df4880b40 req-4466cf43-c831-4c62-8602-f29a54a9ad5f service nova] Enqueued Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 1011.173882] env[69559]: INFO networking_nsxv3.common.synchronization [req-6ed5dd52-3b45-4cca-bba3-571df4880b40 req-4466cf43-c831-4c62-8602-f29a54a9ad5f service nova] Enqueued Resource ID: 87ee45ac-85ac-4537-af2c-85c696caa4ac with Priority: HIGHEST for action port [ 1011.175497] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.175497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.175497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.175497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.175497] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.175497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.175497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.175497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.175497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.175497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.176038] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.176107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.176210] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.176436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.176721] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.177406] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.177406] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.177406] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.177406] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.177406] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.177406] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.182083] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_rules [ 1011.182083] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 1011.182083] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87ee45ac-85ac-4537-af2c-85c696caa4ac with Priority: HIGHEST for action port [ 1011.182083] env[69559]: INFO networking_nsxv3.common.synchronization [req-6ede059f-0449-4d05-9aff-4f86d7c95a46 req-11f37f99-d740-4b43-bb97-0c1961c6fe9f tempest-ServerMetadataNegativeTestJSON-1411965612 tempest-ServerMetadataNegativeTestJSON-1411965612-project-member] Enqueued Resource ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 with Priority: HIGHEST for action security_group_members [ 1011.182083] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.183044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.183044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.183044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.183044] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.183926] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.184088] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.184351] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-87ee45ac-85ac-4537-af2c-85c696caa4ac taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.184552] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87ee45ac-85ac-4537-af2c-85c696caa4ac" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.184635] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87ee45ac-85ac-4537-af2c-85c696caa4ac" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.184862] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87ee45ac-85ac-4537-af2c-85c696caa4ac" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.184978] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87ee45ac-85ac-4537-af2c-85c696caa4ac',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.187221] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 with Priority: HIGHEST for action security_group_members [ 1011.191151] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.191374] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.191428] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.191602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.191762] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.191857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.191907] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.192064] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.192185] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.192818] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('233eac4d-0cf7-44e3-b0cf-9c09c50ed577',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.683085] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9b79819-0a51-4cc6-8e3e-f823f0b89406: rpc.has_security_group_logging(os_id): False [ 1011.691935] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 87ee45ac-85ac-4537-af2c-85c696caa4ac with status ACTIVE [ 1011.692335] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.692556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.692666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.692963] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.693120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.693387] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.693540] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.693642] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.693873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.693997] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.694313] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.694464] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.694566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.695068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.695068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.695068] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 87ee45ac-85ac-4537-af2c-85c696caa4ac is going to be updated. [ 1011.696685] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.696829] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.697214] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.697372] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.697473] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.697705] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.697831] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.698173] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.698386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.698471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.698642] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.698726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.698843] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 is going to be updated. [ 1011.703817] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.704036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.704140] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.704381] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.704499] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.704756] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.704977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.705113] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.705391] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.705473] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.705774] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.705917] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.706022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.706243] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.706373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.706740] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.710166] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.710304] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.710566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.710794] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.710850] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 is going to be updated. [ 1011.721434] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.721596] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.721666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.721905] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.722061] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.722226] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87ee45ac-85ac-4537-af2c-85c696caa4ac" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.743875] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.744114] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.744190] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.747109] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.747109] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.753448] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 in Status: IN_PROGRESS for 2s [ 1011.774618] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.774774] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.774843] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.775462] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.775734] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.791575] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: IN_PROGRESS for 2s [ 1011.866664] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: SUCCESS [ 1011.866878] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 deletion is rescheduled due to dependency. [ 1011.866983] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.867172] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.867527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.867686] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.867797] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.867876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.868034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.868120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.868219] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.219680] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 1012.219795] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d deletion is rescheduled due to dependency. [ 1012.220624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.371852] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.878125] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.978313] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51f74e50-136f-49a9-8456-6841ae996220 in Status: SUCCESS [ 1012.978313] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.382010] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.382175] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.382248] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.383051] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.383051] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.383051] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 is going to be updated. [ 1013.443123] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.443286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.443357] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.443565] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.443725] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.454263] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: IN_PROGRESS for 2s [ 1013.763753] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 in Status: SUCCESS [ 1013.763753] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 deletion is rescheduled due to dependency. [ 1013.763753] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.805058] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: SUCCESS [ 1013.805058] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.464353] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: SUCCESS [ 1015.464353] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.464765] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.464765] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.465100] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.465347] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.465432] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.465645] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.465715] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.465791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.465935] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.971281] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.971281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.971281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.971281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.971281] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.971281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.971281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.971281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.971281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.971281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.971281] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.971281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.971281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.971281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.971281] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.971281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.972552] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.972552] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.972552] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.972552] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.972552] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.191524] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1016.191679] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1016.474425] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55a5191b-a436-4df6-a235-6b2c46e6eea7: rpc.has_security_group_logging(os_id): False [ 1016.499025] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.499025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.499025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.499025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.499025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.499025] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.499025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.499025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.499025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.499025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.499025] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.499025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.499025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.499025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.499025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.500033] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.500033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.500033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.500033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.500033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.500930] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 is going to be updated. [ 1016.556739] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.556914] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.556914] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.557075] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.557302] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.573499] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: IN_PROGRESS for 2s [ 1018.251422] env[69559]: INFO networking_nsxv3.common.synchronization [req-e614dea9-2725-43c7-ae43-1c3017495f0b req-d8811b64-2775-4f2b-86b6-f4f9c0cfa21c tempest-ImagesOneServerNegativeTestJSON-1590344667 tempest-ImagesOneServerNegativeTestJSON-1590344667-project-member] Enqueued Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_members [ 1018.251941] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_members [ 1018.252280] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.252461] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.252589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.252944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.253211] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.253354] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.253456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.253585] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.253670] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.253779] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.589257] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: SUCCESS [ 1018.589487] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.746384] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-114 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.746597] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-114" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.746727] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-114" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.747087] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-114" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.747365] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.747522] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.747646] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.748387] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.748592] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.748768] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.748888] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.749018] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.752461] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.752461] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1018.752461] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.752461] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.757836] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.757952] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.758012] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.758230] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.758319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.759569] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.759569] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.759569] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.759569] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.759569] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.759569] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b4e023e-3f17-4641-b235-16fa1645d85a already deleted. [ 1018.759569] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.775902] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.776123] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1018.776274] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.776471] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-114" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.776820] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-9262ba27-76ec-4f97-add1-2f9db4da2c3c taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.777478] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-9262ba27-76ec-4f97-add1-2f9db4da2c3c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.777478] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-9262ba27-76ec-4f97-add1-2f9db4da2c3c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.777610] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-9262ba27-76ec-4f97-add1-2f9db4da2c3c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.777706] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9262ba27-76ec-4f97-add1-2f9db4da2c3c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.281164] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.281582] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.281582] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.281930] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.282104] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.282269] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 9262ba27-76ec-4f97-add1-2f9db4da2c3c not found, creating... [ 1019.282589] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.282757] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.282875] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.283128] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.283272] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.283563] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.283718] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.283864] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.287301] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.288567] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.288830] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 9262ba27-76ec-4f97-add1-2f9db4da2c3c is going to be created. [ 1019.307972] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.308754] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.308754] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.309191] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.309576] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.309930] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-9262ba27-76ec-4f97-add1-2f9db4da2c3c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.009141] env[69559]: INFO networking_nsxv3.common.synchronization [None req-118388d4-755a-4247-9625-0753851cf9d6 None None] Enqueued Resource ID: de920d30-a412-499b-8407-67ebea7247ae with Priority: HIGHEST for action port [ 1020.010613] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de920d30-a412-499b-8407-67ebea7247ae with Priority: HIGHEST for action port [ 1020.010613] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-de920d30-a412-499b-8407-67ebea7247ae taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.010613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de920d30-a412-499b-8407-67ebea7247ae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.010613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de920d30-a412-499b-8407-67ebea7247ae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.010868] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de920d30-a412-499b-8407-67ebea7247ae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.010868] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de920d30-a412-499b-8407-67ebea7247ae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.321555] env[69559]: INFO networking_nsxv3.common.synchronization [req-e614dea9-2725-43c7-ae43-1c3017495f0b req-4a1b6fe1-1f91-4dfa-951d-26fadb33ef7d service nova] Enqueued Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_rules [ 1020.321796] env[69559]: INFO networking_nsxv3.common.synchronization [req-e614dea9-2725-43c7-ae43-1c3017495f0b req-4a1b6fe1-1f91-4dfa-951d-26fadb33ef7d service nova] Enqueued Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_members [ 1020.321796] env[69559]: INFO networking_nsxv3.common.synchronization [req-e614dea9-2725-43c7-ae43-1c3017495f0b req-4a1b6fe1-1f91-4dfa-951d-26fadb33ef7d service nova] Enqueued Resource ID: 9262ba27-76ec-4f97-add1-2f9db4da2c3c with Priority: HIGHEST for action port [ 1020.322016] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_rules [ 1020.322084] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_members [ 1020.322158] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9262ba27-76ec-4f97-add1-2f9db4da2c3c with Priority: HIGHEST for action port [ 1020.323194] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.324168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.325307] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.325307] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.325307] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.325464] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.325539] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.325597] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.325755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.325954] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.326100] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.326699] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.326699] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.326699] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.326699] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.327248] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-9262ba27-76ec-4f97-add1-2f9db4da2c3c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.327484] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9262ba27-76ec-4f97-add1-2f9db4da2c3c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.327484] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9262ba27-76ec-4f97-add1-2f9db4da2c3c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.327653] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9262ba27-76ec-4f97-add1-2f9db4da2c3c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.327745] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9262ba27-76ec-4f97-add1-2f9db4da2c3c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.514052] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de920d30-a412-499b-8407-67ebea7247ae [ 1020.514309] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.514446] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.514528] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.514711] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.514798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.514893] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de920d30-a412-499b-8407-67ebea7247ae already deleted. [ 1020.514971] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de920d30-a412-499b-8407-67ebea7247ae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.706496] env[69559]: INFO networking_nsxv3.common.synchronization [req-74ae26a6-68e6-41f2-b0f4-0accb7faed2f req-01771c01-4ccc-4978-9a27-42e9d28529ec tempest-AttachInterfacesV270Test-2057930510 tempest-AttachInterfacesV270Test-2057930510-project-member] Enqueued Resource ID: 51f74e50-136f-49a9-8456-6841ae996220 with Priority: HIGHEST for action security_group_members [ 1020.707053] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51f74e50-136f-49a9-8456-6841ae996220 with Priority: HIGHEST for action security_group_members [ 1020.707382] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-51f74e50-136f-49a9-8456-6841ae996220 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.707506] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.707567] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.707753] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.707900] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.707993] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.708468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.708577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.708660] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.708839] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51f74e50-136f-49a9-8456-6841ae996220',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.829884] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.830082] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.830610] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.831286] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9262ba27-76ec-4f97-add1-2f9db4da2c3c with status ACTIVE [ 1020.831424] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.831859] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.831859] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.831859] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.831983] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.832111] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.832197] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.832262] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.832426] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.832517] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.832723] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.832806] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.832864] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.833030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.833105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.833191] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9262ba27-76ec-4f97-add1-2f9db4da2c3c is going to be updated. [ 1020.854787] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.854787] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.854787] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.854787] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.855197] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.855197] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9262ba27-76ec-4f97-add1-2f9db4da2c3c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.211130] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.211354] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.211449] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.211653] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.211752] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.211988] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.212124] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.212421] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.212421] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.212421] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.214116] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51f74e50-136f-49a9-8456-6841ae996220 is going to be updated. [ 1021.238125] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.238308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.238377] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.239208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.239208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.246899] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51f74e50-136f-49a9-8456-6841ae996220 in Status: IN_PROGRESS for 2s [ 1021.336580] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.840997] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.841296] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.841296] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.841428] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.841527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.841658] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b4e023e-3f17-4641-b235-16fa1645d85a is going to be created. [ 1021.862638] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.862876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.862876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.863042] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.863197] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.871474] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b4e023e-3f17-4641-b235-16fa1645d85a in Status: UNINITIALIZED for 2s [ 1022.320253] env[69559]: INFO networking_nsxv3.common.synchronization [None req-8569ce69-fe73-40d2-989b-2e347395481c None None] Enqueued Resource ID: 33a07999-6821-4a7f-a17b-270a36772340 with Priority: HIGHEST for action port [ 1022.322146] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33a07999-6821-4a7f-a17b-270a36772340 with Priority: HIGHEST for action port [ 1022.322146] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-33a07999-6821-4a7f-a17b-270a36772340 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.322146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33a07999-6821-4a7f-a17b-270a36772340" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.322146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33a07999-6821-4a7f-a17b-270a36772340" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.322146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33a07999-6821-4a7f-a17b-270a36772340" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.322146] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33a07999-6821-4a7f-a17b-270a36772340',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.824796] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33a07999-6821-4a7f-a17b-270a36772340 [ 1022.824796] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.824796] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.824796] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.824796] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.824796] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.824796] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33a07999-6821-4a7f-a17b-270a36772340 already deleted. [ 1022.824796] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33a07999-6821-4a7f-a17b-270a36772340" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.258018] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51f74e50-136f-49a9-8456-6841ae996220 in Status: SUCCESS [ 1023.258222] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51f74e50-136f-49a9-8456-6841ae996220 deletion is rescheduled due to dependency. [ 1023.258343] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.882166] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b4e023e-3f17-4641-b235-16fa1645d85a in Status: SUCCESS [ 1023.882490] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.882552] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.882776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.882968] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.883100] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.883164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.883307] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.883387] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.883471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.883560] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.386222] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.386385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.386459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.386675] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.386837] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.386932] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.386994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.387150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.387238] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.387324] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.387466] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.387556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.387643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.387816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.387970] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.388086] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.388146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.388442] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.388536] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.388627] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.388722] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.890669] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b4e023e-3f17-4641-b235-16fa1645d85a: rpc.has_security_group_logging(os_id): False [ 1024.907926] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.908155] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.908155] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.909023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.909023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.909023] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.909023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.909023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.909307] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.909307] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.909307] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.909445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.909445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.909550] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.909621] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.909794] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.909875] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.909933] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.910091] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.910184] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.910472] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b4e023e-3f17-4641-b235-16fa1645d85a is going to be created. [ 1024.964366] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.964583] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.964583] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.964809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.964995] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.976974] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b4e023e-3f17-4641-b235-16fa1645d85a in Status: IN_PROGRESS for 2s [ 1025.065104] env[69559]: INFO networking_nsxv3.common.synchronization [req-03a6a3e4-dea7-4264-83c6-86fd5ebc45c0 req-50db7048-bdfa-4186-8b71-e99c1c9ccd4a tempest-ServerActionsTestOtherA-1414477814 tempest-ServerActionsTestOtherA-1414477814-project-member] Enqueued Resource ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 with Priority: HIGHEST for action security_group_members [ 1025.065657] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 with Priority: HIGHEST for action security_group_members [ 1025.065973] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.067189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.067265] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.067529] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.067707] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.067831] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.067909] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.068101] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.068233] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.068339] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.362683] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-964 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.363126] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.363126] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.363295] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.363546] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.363711] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.363833] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.364066] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.364221] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.364433] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1025.364551] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1025.364684] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1025.364776] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1025.364891] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1025.365020] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1025.365188] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1025.382829] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1025.383096] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1025.383261] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1025.383443] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.383740] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-23965c43-1ee3-4442-baf6-c667abf86b4c taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.383910] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-23965c43-1ee3-4442-baf6-c667abf86b4c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.384143] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-23965c43-1ee3-4442-baf6-c667abf86b4c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.385275] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-23965c43-1ee3-4442-baf6-c667abf86b4c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.385275] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23965c43-1ee3-4442-baf6-c667abf86b4c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.571162] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.571384] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.571384] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.571669] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.571669] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.571848] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.571945] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.572014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.572163] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.572237] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.572318] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 already deleted. [ 1025.572395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.716330] env[69559]: INFO networking_nsxv3.common.synchronization [req-04583d90-6c96-4e35-88f5-aa4d38c76d11 req-11a5df33-b6cb-4b32-86df-d331e8db40fe tempest-ImagesOneServerTestJSON-1917568187 tempest-ImagesOneServerTestJSON-1917568187-project-member] Enqueued Resource ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f with Priority: HIGHEST for action security_group_members [ 1025.716924] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f with Priority: HIGHEST for action security_group_members [ 1025.717284] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.717407] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.717474] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.717671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.717821] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.718139] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.720320] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.720909] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.720909] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.721026] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f12ab78c-28a7-4f2b-a14e-b0a92a64233f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.886819] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.887122] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.887293] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.887634] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.887826] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.888028] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 23965c43-1ee3-4442-baf6-c667abf86b4c not found, creating... [ 1025.888352] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.888550] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.888713] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.889087] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.889353] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.890120] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.890120] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.890120] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.890325] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.890509] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.890687] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 23965c43-1ee3-4442-baf6-c667abf86b4c is going to be created. [ 1025.909575] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.909776] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.909908] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.910178] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.910445] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.910663] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-23965c43-1ee3-4442-baf6-c667abf86b4c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.226203] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.226372] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.226446] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.226700] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.226814] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.226956] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.227065] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.227127] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.227271] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.227352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.227438] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f is going to be updated. [ 1026.253971] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.254175] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.254265] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.254506] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.254667] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.262734] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f in Status: IN_PROGRESS for 2s [ 1026.608134] env[69559]: INFO networking_nsxv3.common.synchronization [req-03a6a3e4-dea7-4264-83c6-86fd5ebc45c0 req-34d3a635-5fb3-43dd-b2a7-da2d6e16889e service nova] Enqueued Resource ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 with Priority: HIGHEST for action security_group_rules [ 1026.608404] env[69559]: INFO networking_nsxv3.common.synchronization [req-03a6a3e4-dea7-4264-83c6-86fd5ebc45c0 req-34d3a635-5fb3-43dd-b2a7-da2d6e16889e service nova] Enqueued Resource ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 with Priority: HIGHEST for action security_group_members [ 1026.608605] env[69559]: INFO networking_nsxv3.common.synchronization [req-03a6a3e4-dea7-4264-83c6-86fd5ebc45c0 req-34d3a635-5fb3-43dd-b2a7-da2d6e16889e service nova] Enqueued Resource ID: 23965c43-1ee3-4442-baf6-c667abf86b4c with Priority: HIGHEST for action port [ 1026.609141] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 with Priority: HIGHEST for action security_group_rules [ 1026.609332] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 with Priority: HIGHEST for action security_group_members [ 1026.609477] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23965c43-1ee3-4442-baf6-c667abf86b4c with Priority: HIGHEST for action port [ 1026.609787] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.609953] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.610067] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.610332] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.610471] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.611299] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.611476] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.611583] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.612241] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.612457] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.612944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.612944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.612944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.612944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.613181] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.613925] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-23965c43-1ee3-4442-baf6-c667abf86b4c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.614094] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23965c43-1ee3-4442-baf6-c667abf86b4c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.614200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23965c43-1ee3-4442-baf6-c667abf86b4c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.614394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23965c43-1ee3-4442-baf6-c667abf86b4c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.614512] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23965c43-1ee3-4442-baf6-c667abf86b4c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.987774] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b4e023e-3f17-4641-b235-16fa1645d85a in Status: SUCCESS [ 1026.988043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.116585] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.116753] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.116972] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23965c43-1ee3-4442-baf6-c667abf86b4c with status ACTIVE [ 1027.117169] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.117282] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.117355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.117737] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.117737] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.117903] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.117903] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.118055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.118135] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.118338] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.118458] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.119022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.119146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.119341] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.119341] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.119744] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23965c43-1ee3-4442-baf6-c667abf86b4c is going to be updated. [ 1027.120701] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.140580] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.140742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.140816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.141049] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.141201] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.141378] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23965c43-1ee3-4442-baf6-c667abf86b4c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.624605] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.130828] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.131241] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.131241] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.131393] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.131393] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.131519] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 is going to be created. [ 1028.157854] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.158026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.158110] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.158303] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.158456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.167452] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 in Status: UNINITIALIZED for 2s [ 1028.273462] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f in Status: SUCCESS [ 1028.273653] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f deletion is rescheduled due to dependency. [ 1028.273896] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.598566] env[69559]: INFO networking_nsxv3.common.synchronization [req-2a85ee4a-a420-4efb-83a2-58c9cec42809 req-6929c336-fed0-49d1-a806-3e2386d95082 tempest-ImagesTestJSON-1150485476 tempest-ImagesTestJSON-1150485476-project-member] Enqueued Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 1029.599114] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGHEST for action security_group_members [ 1029.599416] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.599538] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.599603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.599791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.599947] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.600055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.600116] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.600290] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.600365] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.600454] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.102832] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.103091] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.103091] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.103341] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.103440] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.103641] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.103740] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.103798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.103955] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.104032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.104119] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 is going to be updated. [ 1030.129517] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.129767] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.129900] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.130019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.130191] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.138312] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: IN_PROGRESS for 2s [ 1030.175249] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 in Status: SUCCESS [ 1030.175469] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.175622] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.175829] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.176054] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.176180] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.176240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.176396] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.178018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.178018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.178018] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.679900] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.182858] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78: rpc.has_security_group_logging(os_id): False [ 1031.203020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.203020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.203020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.203020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.203020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.203020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.203020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.203020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.203020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.203020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.203020] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 is going to be created. [ 1031.262217] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.262449] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.262515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.262765] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.262868] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.274204] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 in Status: IN_PROGRESS for 2s [ 1032.024499] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-286 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.024810] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-286" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.025038] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-286" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.025458] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-286" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.025875] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.026153] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.026381] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.026788] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.027533] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.027533] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.027533] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1032.027533] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1032.027738] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1032.027738] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.027835] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1032.027971] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1032.045796] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1032.046010] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1032.046131] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1032.046306] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-286" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.046600] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-8b195509-2c2b-4af5-b2c9-c8ed1de56059 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.046769] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-8b195509-2c2b-4af5-b2c9-c8ed1de56059" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.046895] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-8b195509-2c2b-4af5-b2c9-c8ed1de56059" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.047201] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-8b195509-2c2b-4af5-b2c9-c8ed1de56059" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.047330] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b195509-2c2b-4af5-b2c9-c8ed1de56059',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.150088] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: IN_PROGRESS for 4s [ 1032.552772] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.552888] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.553087] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.553371] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.553532] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.553839] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.554015] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.554164] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.554392] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.554538] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.554831] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.554992] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.555131] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.556035] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.556035] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.556035] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 8b195509-2c2b-4af5-b2c9-c8ed1de56059 is going to be updated. [ 1032.576156] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.576339] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.577042] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.577505] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.577777] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.578085] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-8b195509-2c2b-4af5-b2c9-c8ed1de56059" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.296057] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 in Status: SUCCESS [ 1033.296372] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.397281] env[69559]: INFO networking_nsxv3.common.synchronization [req-a23f38f8-2865-4db8-9a50-e1476f61d5d6 req-c9eccefb-35fc-4b4a-ad0d-b6f96124afd9 service nova] Enqueued Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGHEST for action security_group_rules [ 1033.397543] env[69559]: INFO networking_nsxv3.common.synchronization [req-a23f38f8-2865-4db8-9a50-e1476f61d5d6 req-c9eccefb-35fc-4b4a-ad0d-b6f96124afd9 service nova] Enqueued Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGHEST for action security_group_members [ 1033.397613] env[69559]: INFO networking_nsxv3.common.synchronization [req-a23f38f8-2865-4db8-9a50-e1476f61d5d6 req-c9eccefb-35fc-4b4a-ad0d-b6f96124afd9 service nova] Enqueued Resource ID: 8b195509-2c2b-4af5-b2c9-c8ed1de56059 with Priority: HIGHEST for action port [ 1033.397818] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGHEST for action security_group_rules [ 1033.397940] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGHEST for action security_group_members [ 1033.398059] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b195509-2c2b-4af5-b2c9-c8ed1de56059 with Priority: HIGHEST for action port [ 1033.398664] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbcf9733-e0a4-4cd5-bcff-a59904ddee14 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.398755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.398860] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.399078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.399166] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.399985] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.400099] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.400161] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.400427] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.400510] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.400601] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.400660] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.400800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.400880] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.400964] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.401733] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b195509-2c2b-4af5-b2c9-c8ed1de56059 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.402025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b195509-2c2b-4af5-b2c9-c8ed1de56059" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.402025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b195509-2c2b-4af5-b2c9-c8ed1de56059" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.402328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b195509-2c2b-4af5-b2c9-c8ed1de56059" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.402328] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b195509-2c2b-4af5-b2c9-c8ed1de56059',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.492615] env[69559]: INFO networking_nsxv3.common.synchronization [req-9fa5fe83-224a-4e78-a82d-2487086dbd1b req-2c961f2e-9286-4e45-b3a7-b9afe89b70b1 tempest-ListServersNegativeTestJSON-36957386 tempest-ListServersNegativeTestJSON-36957386-project-member] Enqueued Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_members [ 1033.493030] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_members [ 1033.493754] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.493754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.493754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.493754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.494062] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.494062] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.498099] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.498361] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.498461] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.498564] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.814615] env[69559]: INFO networking_nsxv3.common.synchronization [req-f9dbd572-0cce-4881-9969-89ce6227a06f req-30bdbc70-e5dc-48e2-b91b-a2e80099b45f tempest-ListServersNegativeTestJSON-36957386 tempest-ListServersNegativeTestJSON-36957386-project-member] Enqueued Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_members [ 1033.815425] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGHEST for action security_group_members [ 1033.815758] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.816572] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.907583] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.907583] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.907583] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.910063] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b195509-2c2b-4af5-b2c9-c8ed1de56059 with status ACTIVE [ 1033.910063] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.910063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.910063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.910063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.910063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.910063] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.910063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.910063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.910063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.910063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.910063] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.910063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.910063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.910063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.911164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.911164] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b195509-2c2b-4af5-b2c9-c8ed1de56059 is going to be updated. [ 1033.933412] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.933632] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.933632] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.934471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.934471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.934471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b195509-2c2b-4af5-b2c9-c8ed1de56059" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.002913] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.159600] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 in Status: SUCCESS [ 1034.159843] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 deletion is rescheduled due to dependency. [ 1034.160042] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.413638] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.505045] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.920022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.920022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.920022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.920022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.920022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.920022] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 is going to be updated. [ 1034.946570] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.946832] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.946832] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.946980] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.947138] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.955413] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 in Status: IN_PROGRESS for 2s [ 1035.007140] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.007411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.007562] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.007872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.007990] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.008132] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 is going to be updated. [ 1035.038639] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.038861] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.038979] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.039327] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.039674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.049363] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: IN_PROGRESS for 2s [ 1035.091672] env[69559]: INFO networking_nsxv3.common.synchronization [req-13ee217b-1982-4a7f-9b29-4d6b971add82 req-87dd4192-53a1-4599-861e-15ec1fa4787a tempest-ServersTestJSON-514909010 tempest-ServersTestJSON-514909010-project-member] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1035.092376] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1035.092856] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.092856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.093100] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.093100] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.093244] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.093338] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.093396] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.093578] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.093668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.093762] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.597260] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.830542] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-640 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.830818] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.830994] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.831492] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.831900] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.832082] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.832319] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.832723] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.832946] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.833278] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1035.833525] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1035.833747] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1035.833948] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1035.834166] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1035.834332] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1035.834630] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1035.854555] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1035.854793] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1035.854962] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1035.855327] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.855766] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-2435c5e0-bdf3-4ada-820c-0a65f02c76f0 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.856398] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-2435c5e0-bdf3-4ada-820c-0a65f02c76f0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.856398] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-2435c5e0-bdf3-4ada-820c-0a65f02c76f0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.856565] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-2435c5e0-bdf3-4ada-820c-0a65f02c76f0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.856729] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2435c5e0-bdf3-4ada-820c-0a65f02c76f0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.099929] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.360328] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.360942] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.361264] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.361734] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.362092] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.362516] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 2435c5e0-bdf3-4ada-820c-0a65f02c76f0 not found, creating... [ 1036.363023] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.363415] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.363721] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.364166] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.364494] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.364976] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.367624] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.367624] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.367624] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.367624] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.367624] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 2435c5e0-bdf3-4ada-820c-0a65f02c76f0 is going to be created. [ 1036.389067] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.389067] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.389067] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.389067] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.389067] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.389067] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-2435c5e0-bdf3-4ada-820c-0a65f02c76f0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.604701] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.604701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.604701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.604701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.604701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.604701] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1036.641158] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.641158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.641158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.641158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.641158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.649965] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1036.967010] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 in Status: SUCCESS [ 1036.967010] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.967010] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.967296] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.967494] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.967621] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.967681] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.967847] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.967927] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.968032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.968124] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.059219] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: SUCCESS [ 1037.059219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.059219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.059219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.059219] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.059219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.059219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.059219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.059219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.059219] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.358950] env[69559]: INFO networking_nsxv3.common.synchronization [req-13ee217b-1982-4a7f-9b29-4d6b971add82 req-4bdbcb5f-b37a-4d36-82ff-10107063e78b service nova] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_rules [ 1037.359152] env[69559]: INFO networking_nsxv3.common.synchronization [req-13ee217b-1982-4a7f-9b29-4d6b971add82 req-4bdbcb5f-b37a-4d36-82ff-10107063e78b service nova] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1037.359243] env[69559]: INFO networking_nsxv3.common.synchronization [req-13ee217b-1982-4a7f-9b29-4d6b971add82 req-4bdbcb5f-b37a-4d36-82ff-10107063e78b service nova] Enqueued Resource ID: 2435c5e0-bdf3-4ada-820c-0a65f02c76f0 with Priority: HIGHEST for action port [ 1037.363020] env[69559]: INFO networking_nsxv3.common.synchronization [req-b231fae2-aa85-492e-b788-0f228d5f0a56 req-4a052994-eca8-4c4a-90d6-c37edee6c305 tempest-ServerRescueNegativeTestJSON-1113411482 tempest-ServerRescueNegativeTestJSON-1113411482-project-member] Enqueued Resource ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 with Priority: HIGHEST for action security_group_members [ 1037.363020] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_rules [ 1037.363020] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2435c5e0-bdf3-4ada-820c-0a65f02c76f0 with Priority: HIGHEST for action port [ 1037.363020] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1037.363020] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 with Priority: HIGHEST for action security_group_members [ 1037.363575] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.364068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.364068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.364068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.364068] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.365340] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-2435c5e0-bdf3-4ada-820c-0a65f02c76f0 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.365340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2435c5e0-bdf3-4ada-820c-0a65f02c76f0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.365501] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2435c5e0-bdf3-4ada-820c-0a65f02c76f0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.365641] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2435c5e0-bdf3-4ada-820c-0a65f02c76f0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.365737] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2435c5e0-bdf3-4ada-820c-0a65f02c76f0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.370960] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.371102] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.371335] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.371426] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.371479] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.371665] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.371904] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.371904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.372049] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.372094] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.372184] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.372275] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.470910] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.471749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.472022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.472264] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.472454] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.472549] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.472610] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.472751] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.472834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.472914] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.473514] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.473612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.473915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.474139] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.475495] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.475495] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.475495] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.475495] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.476070] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.476203] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.476307] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.563968] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.564104] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.564180] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.564386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.564477] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.564665] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.564762] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.564931] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.565116] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.565197] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.565283] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 is going to be updated. [ 1037.590464] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.590613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.590683] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.590882] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.591030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.599915] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: IN_PROGRESS for 2s [ 1037.651718] env[69559]: INFO networking_nsxv3.common.synchronization [req-4f548715-d74d-464b-8d1b-8c810046b857 req-b2c0cd92-79a8-4597-be4d-50a0f7ea1f9b tempest-ServerAddressesNegativeTestJSON-2056031491 tempest-ServerAddressesNegativeTestJSON-2056031491-project-member] Enqueued Resource ID: f1375255-0519-4538-bc3f-1cd9a0e0744c with Priority: HIGHEST for action security_group_members [ 1037.652022] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1375255-0519-4538-bc3f-1cd9a0e0744c with Priority: HIGHEST for action security_group_members [ 1037.652799] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1375255-0519-4538-bc3f-1cd9a0e0744c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.652920] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.652983] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.653941] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.654119] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.654220] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.654282] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.654428] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.654507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.654594] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1375255-0519-4538-bc3f-1cd9a0e0744c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.712481] env[69559]: INFO networking_nsxv3.common.synchronization [req-3141b31b-01fb-4bc3-8c8b-a2e3fee85f38 req-c7b848c1-3b8a-46d5-9931-00ca3fd86141 tempest-AttachVolumeNegativeTest-1400300488 tempest-AttachVolumeNegativeTest-1400300488-project-member] Enqueued Resource ID: 362fb317-5783-4d37-bba5-4e590ce7111d with Priority: HIGHEST for action security_group_members [ 1037.713060] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 362fb317-5783-4d37-bba5-4e590ce7111d with Priority: HIGHEST for action security_group_members [ 1037.713385] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-362fb317-5783-4d37-bba5-4e590ce7111d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.713509] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.713613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.713816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.713969] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.718294] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.718294] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.718294] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.718294] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.718294] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('362fb317-5783-4d37-bba5-4e590ce7111d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.874277] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.875068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.875068] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2435c5e0-bdf3-4ada-820c-0a65f02c76f0 with status ACTIVE [ 1037.875068] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.875320] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.875320] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.875464] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.875573] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.875747] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.875884] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.875974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.876243] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.876469] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.876551] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.876628] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.876683] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.876861] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.876976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.877589] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2435c5e0-bdf3-4ada-820c-0a65f02c76f0 is going to be updated. [ 1037.878784] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.878784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.878969] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.879119] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.900533] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.902704] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.902704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.902704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.902704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.902704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.902704] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 is going to be updated. [ 1037.903255] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.903352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.903436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.903643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.903900] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.904028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2435c5e0-bdf3-4ada-820c-0a65f02c76f0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.929279] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.930053] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.930053] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.930422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.930422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.940981] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 in Status: IN_PROGRESS for 2s [ 1037.979163] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbcf9733-e0a4-4cd5-bcff-a59904ddee14: rpc.has_security_group_logging(os_id): False [ 1038.022262] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.022414] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.022479] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.022689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.062058] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.062316] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.062423] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.062548] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.062699] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.062782] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.062992] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.063147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.063147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.063311] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.063445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.063531] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.063622] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.063673] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.063813] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.063894] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.063982] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 is going to be updated. [ 1038.149426] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.149426] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.149426] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.149426] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.149426] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.156889] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.157226] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.157442] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.157728] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.157829] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.158064] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.158214] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.158285] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.158434] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.158498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.158590] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1375255-0519-4538-bc3f-1cd9a0e0744c already deleted. [ 1038.158670] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.165024] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 in Status: IN_PROGRESS for 2s [ 1038.174091] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-996 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.174314] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-996" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.174453] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-996" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.174810] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-996" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.175690] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.176180] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.176561] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.177277] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.177630] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.178370] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1038.178569] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1038.178778] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1038.178937] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1038.179116] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1038.179258] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1038.179411] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1038.206491] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1038.207061] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1038.207358] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1038.209390] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-996" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.210508] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-2f620845-b32b-4231-af72-49c1e398e825 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.210508] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-2f620845-b32b-4231-af72-49c1e398e825" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.210508] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-2f620845-b32b-4231-af72-49c1e398e825" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.210784] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-2f620845-b32b-4231-af72-49c1e398e825" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.212138] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f620845-b32b-4231-af72-49c1e398e825',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.219173] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.221024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.221024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.221176] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.268215] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.268215] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.268215] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.268215] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.268557] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.268557] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.269608] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 362fb317-5783-4d37-bba5-4e590ce7111d is going to be updated. [ 1038.324875] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.325060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.325121] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.325356] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.325513] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.335390] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 362fb317-5783-4d37-bba5-4e590ce7111d in Status: IN_PROGRESS for 2s [ 1038.659967] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1038.660305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.660426] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.660647] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.660849] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.660967] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.661055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.661207] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.661286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.661384] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.717151] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.717467] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.717604] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.717899] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.718487] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.718487] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 2f620845-b32b-4231-af72-49c1e398e825 not found, creating... [ 1038.718622] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.718826] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.718971] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.719256] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.719411] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.719702] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.719864] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.719990] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.720221] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.720405] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.720543] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 2f620845-b32b-4231-af72-49c1e398e825 is going to be created. [ 1038.739638] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.739949] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.740115] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.740488] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.740833] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.741178] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-2f620845-b32b-4231-af72-49c1e398e825" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.164250] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.609015] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 in Status: SUCCESS [ 1039.609249] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 deletion is rescheduled due to dependency. [ 1039.609387] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.614778] env[69559]: INFO networking_nsxv3.common.synchronization [req-4f548715-d74d-464b-8d1b-8c810046b857 req-aeaf67a1-15af-4484-b843-210c8b4e0297 service nova] Enqueued Resource ID: f1375255-0519-4538-bc3f-1cd9a0e0744c with Priority: HIGHEST for action security_group_rules [ 1039.615301] env[69559]: INFO networking_nsxv3.common.synchronization [req-4f548715-d74d-464b-8d1b-8c810046b857 req-aeaf67a1-15af-4484-b843-210c8b4e0297 service nova] Enqueued Resource ID: f1375255-0519-4538-bc3f-1cd9a0e0744c with Priority: HIGHEST for action security_group_members [ 1039.615534] env[69559]: INFO networking_nsxv3.common.synchronization [req-4f548715-d74d-464b-8d1b-8c810046b857 req-aeaf67a1-15af-4484-b843-210c8b4e0297 service nova] Enqueued Resource ID: 2f620845-b32b-4231-af72-49c1e398e825 with Priority: HIGHEST for action port [ 1039.616098] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1375255-0519-4538-bc3f-1cd9a0e0744c with Priority: HIGHEST for action security_group_rules [ 1039.616233] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1375255-0519-4538-bc3f-1cd9a0e0744c with Priority: HIGHEST for action security_group_members [ 1039.616518] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f620845-b32b-4231-af72-49c1e398e825 with Priority: HIGHEST for action port [ 1039.616621] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1375255-0519-4538-bc3f-1cd9a0e0744c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.616727] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.616792] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.617050] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.617111] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1375255-0519-4538-bc3f-1cd9a0e0744c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.617901] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1375255-0519-4538-bc3f-1cd9a0e0744c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.618019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.618085] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.619291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.619443] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.619547] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.619626] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.619773] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.620080] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.620080] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1375255-0519-4538-bc3f-1cd9a0e0744c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.620698] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f620845-b32b-4231-af72-49c1e398e825 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.620816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f620845-b32b-4231-af72-49c1e398e825" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.620875] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f620845-b32b-4231-af72-49c1e398e825" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.621011] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f620845-b32b-4231-af72-49c1e398e825" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.623403] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f620845-b32b-4231-af72-49c1e398e825',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.666932] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.971810] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 in Status: SUCCESS [ 1039.971810] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 deletion is rescheduled due to dependency. [ 1039.971810] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.126587] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1375255-0519-4538-bc3f-1cd9a0e0744c taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.126587] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.126698] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f1375255-0519-4538-bc3f-1cd9a0e0744c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.130318] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f620845-b32b-4231-af72-49c1e398e825 with status ACTIVE [ 1040.130318] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.130318] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.130318] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.130318] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.130318] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.130318] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.130710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.130710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.130710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.130810] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.131251] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.131251] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.131251] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.131251] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.131489] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.131489] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f620845-b32b-4231-af72-49c1e398e825 is going to be updated. [ 1040.149257] env[69559]: INFO networking_nsxv3.common.synchronization [req-2d58c447-d3a7-40ab-b33c-fed9a2a6049a req-0018f541-9b96-4e48-a597-b7c62dcf89e8 tempest-ImagesOneServerNegativeTestJSON-1590344667 tempest-ImagesOneServerNegativeTestJSON-1590344667-project-member] Enqueued Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_members [ 1040.149883] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_members [ 1040.150858] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.151685] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.151781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.151957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.152224] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.152433] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.152521] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.152716] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.152785] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.152886] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.156136] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.156266] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.156908] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.156908] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.156908] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.156908] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f620845-b32b-4231-af72-49c1e398e825" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.169554] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.171570] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.171671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.172146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.172146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.172146] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1040.195759] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 in Status: SUCCESS [ 1040.197586] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.224533] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.224533] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.224533] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.224533] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.224533] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.236058] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1040.358051] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 362fb317-5783-4d37-bba5-4e590ce7111d in Status: SUCCESS [ 1040.359021] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 362fb317-5783-4d37-bba5-4e590ce7111d deletion is rescheduled due to dependency. [ 1040.359021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-362fb317-5783-4d37-bba5-4e590ce7111d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.629403] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f1375255-0519-4538-bc3f-1cd9a0e0744c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.655771] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.655771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.655771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.655771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.655771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.655771] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.656266] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.656266] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.656266] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.656266] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.656422] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b4e023e-3f17-4641-b235-16fa1645d85a is going to be updated. [ 1040.684426] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.684813] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.684813] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.685015] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.685098] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.698554] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b4e023e-3f17-4641-b235-16fa1645d85a in Status: IN_PROGRESS for 2s [ 1040.859060] env[69559]: INFO networking_nsxv3.common.synchronization [None req-4b7bbc0f-ffba-4e71-ae8c-aad70ff1980c None None] Enqueued Resource ID: 207d917b-158f-4378-be87-f29c07b0b704 with Priority: HIGHEST for action port [ 1040.863668] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 207d917b-158f-4378-be87-f29c07b0b704 with Priority: HIGHEST for action port [ 1040.865435] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-207d917b-158f-4378-be87-f29c07b0b704 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.865435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-207d917b-158f-4378-be87-f29c07b0b704" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.865435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-207d917b-158f-4378-be87-f29c07b0b704" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.865435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-207d917b-158f-4378-be87-f29c07b0b704" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.865655] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('207d917b-158f-4378-be87-f29c07b0b704',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.134687] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.134687] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.134687] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.134687] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.134687] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.134687] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1375255-0519-4538-bc3f-1cd9a0e0744c is going to be created. [ 1041.163662] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.163861] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.163940] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.164182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.164340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.177688] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1375255-0519-4538-bc3f-1cd9a0e0744c in Status: UNINITIALIZED for 2s [ 1041.370935] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 207d917b-158f-4378-be87-f29c07b0b704 [ 1041.370935] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.370935] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.371367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.371367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.371436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.371572] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:207d917b-158f-4378-be87-f29c07b0b704 already deleted. [ 1041.371614] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-207d917b-158f-4378-be87-f29c07b0b704" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.246531] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1042.246763] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.246946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.247182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.247378] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.247497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.247564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.247712] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.247836] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.247949] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.248067] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.710561] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b4e023e-3f17-4641-b235-16fa1645d85a in Status: SUCCESS [ 1042.711280] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b4e023e-3f17-4641-b235-16fa1645d85a deletion is rescheduled due to dependency. [ 1042.711800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.753024] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.753024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.753024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.753024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.753024] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.753024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.753024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.753024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.753024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.753024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.753024] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.753024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.753024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.753024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.753024] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.753024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.753593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.753593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.753593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.753593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.753593] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.192138] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1375255-0519-4538-bc3f-1cd9a0e0744c in Status: SUCCESS [ 1043.192138] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.192329] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.192596] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.192894] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.193092] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.193409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.193691] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.193817] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.193937] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.194068] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f1375255-0519-4538-bc3f-1cd9a0e0744c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.256155] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebf5f404-8f48-487f-b212-72786dc389e8: rpc.has_security_group_logging(os_id): False [ 1043.266924] env[69559]: INFO networking_nsxv3.common.synchronization [None req-f30636e2-2052-4fc6-a720-611358cb446f None None] Enqueued Resource ID: c2c34879-2c1e-4079-8f22-e21756b97b07 with Priority: HIGHEST for action port [ 1043.267590] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2c34879-2c1e-4079-8f22-e21756b97b07 with Priority: HIGHEST for action port [ 1043.267876] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2c34879-2c1e-4079-8f22-e21756b97b07 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.267998] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2c34879-2c1e-4079-8f22-e21756b97b07" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.268189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2c34879-2c1e-4079-8f22-e21756b97b07" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.268569] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2c34879-2c1e-4079-8f22-e21756b97b07" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.268845] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2c34879-2c1e-4079-8f22-e21756b97b07',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.278032] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.278177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.278989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.278989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.278989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.278989] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.278989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.278989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.279296] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.279468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.279588] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.279757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.279757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.279876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.279951] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.281050] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.281050] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.281050] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.281050] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.281050] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.281050] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1043.345013] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.346321] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.346438] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.346687] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.346879] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.362279] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1043.697470] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1375255-0519-4538-bc3f-1cd9a0e0744c taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.697593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.697717] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.698096] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.698389] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.698584] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.698681] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.698974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.699146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.699299] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.699566] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1375255-0519-4538-bc3f-1cd9a0e0744c taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.699726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.699874] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.700968] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.700968] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.700968] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.700968] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.700968] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.701737] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.701737] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.701737] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f1375255-0519-4538-bc3f-1cd9a0e0744c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.772750] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2c34879-2c1e-4079-8f22-e21756b97b07 [ 1043.773644] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.773644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.773644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.773644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.773644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.773644] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2c34879-2c1e-4079-8f22-e21756b97b07 already deleted. [ 1043.773923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2c34879-2c1e-4079-8f22-e21756b97b07" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.068481] env[69559]: INFO networking_nsxv3.common.synchronization [req-ce0f8bab-2093-400a-8edf-cef1b4300cdf req-f8007aa7-40fa-4704-8936-c7310df76ab7 tempest-DeleteServersTestJSON-1423597435 tempest-DeleteServersTestJSON-1423597435-project-member] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 1044.068965] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 1044.069301] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.069487] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.069554] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.069759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.069914] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.070851] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.070961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.071162] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.071282] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.071404] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.203567] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f1375255-0519-4538-bc3f-1cd9a0e0744c: rpc.has_security_group_logging(os_id): False [ 1044.232464] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.232686] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.232829] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.232999] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.233214] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.233405] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.233649] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.233649] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.233729] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.233795] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.234139] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.234235] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.234339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.235025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.235102] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.238022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.238022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.238022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.238022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.238022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.238022] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1375255-0519-4538-bc3f-1cd9a0e0744c is going to be created. [ 1044.316887] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.317887] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.317887] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.317887] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.318278] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.333986] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1375255-0519-4538-bc3f-1cd9a0e0744c in Status: IN_PROGRESS for 2s [ 1044.382705] env[69559]: INFO networking_nsxv3.common.synchronization [req-03fdc9d7-3f47-45ae-b7a1-9a427bef3b90 req-716565a7-e11b-4372-a8df-9aadbc5b757e tempest-ServersTestManualDisk-1543198047 tempest-ServersTestManualDisk-1543198047-project-member] Enqueued Resource ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 with Priority: HIGHEST for action security_group_members [ 1044.383118] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 with Priority: HIGHEST for action security_group_members [ 1044.383639] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-50135ff4-8447-455b-b0a1-ca85f9b5ef55 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.383639] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.383639] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.383843] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.384542] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.384690] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.384762] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.384881] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.385156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.385156] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50135ff4-8447-455b-b0a1-ca85f9b5ef55',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.575585] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.575757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.575942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.576449] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.576666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.577409] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.577409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.577409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.577568] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.579540] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.579789] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be updated. [ 1044.630102] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.630264] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.630339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.630796] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.630998] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.646114] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 1044.668311] env[69559]: INFO networking_nsxv3.common.synchronization [None req-2971f9ef-03c5-41b7-a760-9317f6b43aa9 None None] Enqueued Resource ID: 1d29a6b6-dde7-4efd-b66f-2fd2a42e716f with Priority: HIGHEST for action port [ 1044.668311] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d29a6b6-dde7-4efd-b66f-2fd2a42e716f with Priority: HIGHEST for action port [ 1044.668311] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d29a6b6-dde7-4efd-b66f-2fd2a42e716f taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.668571] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d29a6b6-dde7-4efd-b66f-2fd2a42e716f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.668603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d29a6b6-dde7-4efd-b66f-2fd2a42e716f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.668932] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d29a6b6-dde7-4efd-b66f-2fd2a42e716f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.669143] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d29a6b6-dde7-4efd-b66f-2fd2a42e716f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.688249] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-596 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.688249] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.688249] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.688941] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.692976] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.692976] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.692976] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.692976] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.692976] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.692976] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.692976] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1044.692976] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1044.692976] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1044.692976] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.692976] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1044.692976] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1044.728921] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1044.729156] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1044.729305] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1044.729497] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.729848] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-249b9359-0352-498c-8561-dc76bdea369c taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.730082] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-249b9359-0352-498c-8561-dc76bdea369c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.730216] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-249b9359-0352-498c-8561-dc76bdea369c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.730595] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-249b9359-0352-498c-8561-dc76bdea369c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.730736] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('249b9359-0352-498c-8561-dc76bdea369c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.887659] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.887659] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.887659] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.887840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.887938] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.888524] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.888710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.888782] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.888989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.889111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.889217] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 is going to be updated. [ 1044.927308] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.927500] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.927556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.927775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.927917] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.943153] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 in Status: IN_PROGRESS for 2s [ 1045.171412] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1d29a6b6-dde7-4efd-b66f-2fd2a42e716f [ 1045.172525] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.172525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.172525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.172525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.172525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.172525] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1d29a6b6-dde7-4efd-b66f-2fd2a42e716f already deleted. [ 1045.172525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d29a6b6-dde7-4efd-b66f-2fd2a42e716f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.234820] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.235097] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.235241] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.235550] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.235712] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.235888] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 249b9359-0352-498c-8561-dc76bdea369c not found, creating... [ 1045.236191] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.236374] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.236539] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.236784] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.236936] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.237457] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.237613] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.237788] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.238049] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.238256] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.238422] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 249b9359-0352-498c-8561-dc76bdea369c is going to be created. [ 1045.262155] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.262365] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.262365] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.262641] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.263480] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.263480] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-249b9359-0352-498c-8561-dc76bdea369c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.374517] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1045.374874] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.134372] env[69559]: INFO networking_nsxv3.common.synchronization [req-ce0f8bab-2093-400a-8edf-cef1b4300cdf req-9be91d90-9a13-475a-9387-f04a1e34eeac service nova] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_rules [ 1046.134372] env[69559]: INFO networking_nsxv3.common.synchronization [req-ce0f8bab-2093-400a-8edf-cef1b4300cdf req-9be91d90-9a13-475a-9387-f04a1e34eeac service nova] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 1046.134372] env[69559]: INFO networking_nsxv3.common.synchronization [req-ce0f8bab-2093-400a-8edf-cef1b4300cdf req-9be91d90-9a13-475a-9387-f04a1e34eeac service nova] Enqueued Resource ID: 249b9359-0352-498c-8561-dc76bdea369c with Priority: HIGHEST for action port [ 1046.134752] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_rules [ 1046.134752] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 1046.139330] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b9359-0352-498c-8561-dc76bdea369c with Priority: HIGHEST for action port [ 1046.139330] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.139330] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.139330] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.139330] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.139330] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.139330] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.139330] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.139580] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-249b9359-0352-498c-8561-dc76bdea369c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.139580] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-249b9359-0352-498c-8561-dc76bdea369c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.139580] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-249b9359-0352-498c-8561-dc76bdea369c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.140824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-249b9359-0352-498c-8561-dc76bdea369c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.140824] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('249b9359-0352-498c-8561-dc76bdea369c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.346599] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1375255-0519-4538-bc3f-1cd9a0e0744c in Status: SUCCESS [ 1046.346834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.674857] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.674857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.674857] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 249b9359-0352-498c-8561-dc76bdea369c with status ACTIVE [ 1046.674857] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.674857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.674857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.674857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.674857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.674857] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.674857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.674857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.674857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.674857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.674857] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.677646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.677646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.677646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.677646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.677646] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 249b9359-0352-498c-8561-dc76bdea369c is going to be updated. [ 1046.677646] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 1046.677646] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d deletion is rescheduled due to dependency. [ 1046.677646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.677646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.677646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.677646] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.677646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.677646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.677646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.677646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.677646] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.677646] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.677646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.677646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.677646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.678735] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.678735] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-249b9359-0352-498c-8561-dc76bdea369c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.955789] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 in Status: SUCCESS [ 1046.955981] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 deletion is rescheduled due to dependency. [ 1046.956150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.167424] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.671835] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.177821] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.178195] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.178195] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.178456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.178456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.178552] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be updated. [ 1048.229274] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.230100] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.230100] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.230100] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.230100] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.248897] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 1049.506112] env[69559]: INFO networking_nsxv3.common.synchronization [None req-7d39e707-c48e-4b80-af99-ef8ea0be5ac5 None None] Enqueued Resource ID: c9dc0dc1-2781-4d0c-afd4-aa86662fa577 with Priority: HIGHEST for action port [ 1049.506112] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9dc0dc1-2781-4d0c-afd4-aa86662fa577 with Priority: HIGHEST for action port [ 1049.506112] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9dc0dc1-2781-4d0c-afd4-aa86662fa577 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.506112] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9dc0dc1-2781-4d0c-afd4-aa86662fa577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.506112] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9dc0dc1-2781-4d0c-afd4-aa86662fa577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.506112] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9dc0dc1-2781-4d0c-afd4-aa86662fa577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.506112] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9dc0dc1-2781-4d0c-afd4-aa86662fa577',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.676266] env[69559]: INFO networking_nsxv3.common.synchronization [req-b16f5803-f3ef-47b2-b785-70ae38916ec5 req-378f12b6-d078-439d-b9da-39f66c1ec550 tempest-ServersTestJSON-514909010 tempest-ServersTestJSON-514909010-project-member] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1049.677106] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1049.677515] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.677956] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.678147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.678440] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.678691] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.678913] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.679072] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.679300] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.679465] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.679627] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.732995] env[69559]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1049.732995] env[69559]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1050.012077] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9dc0dc1-2781-4d0c-afd4-aa86662fa577 [ 1050.012077] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.012077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.012077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.012077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.012077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.012077] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9dc0dc1-2781-4d0c-afd4-aa86662fa577 already deleted. [ 1050.012077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9dc0dc1-2781-4d0c-afd4-aa86662fa577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.184625] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.259967] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 1050.260209] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.260817] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.261072] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.261247] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.261405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.261493] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.261687] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.261784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.261881] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.261970] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.687721] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.766441] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.766917] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.767016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.767267] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.767519] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.768224] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.768347] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.768589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.768877] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.768990] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.769246] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.769350] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.769434] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.769605] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.769725] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.769943] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.770102] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.770211] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.770344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.770490] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.770597] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.190243] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.190243] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.190243] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.190243] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.190243] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.190243] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1051.218020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.218147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.218218] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.218431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.218710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.228623] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1051.273452] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 839ae40b-5f13-4259-8e2a-b943b206557d: rpc.has_security_group_logging(os_id): False [ 1051.291642] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.291869] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.291869] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.292082] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.292176] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.292438] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.293111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.293111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.293111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.293111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.293355] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.293355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.293355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.293448] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.293564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.293811] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.293978] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.294061] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.294208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.294284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.294369] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be updated. [ 1051.368349] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.368596] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.368674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.368914] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.369043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.380980] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 1051.449699] env[69559]: INFO networking_nsxv3.common.synchronization [None req-ceac7b3f-c6b0-4f4b-bc1f-0e58b38fc291 None None] Enqueued Resource ID: bfd9db02-c69c-4a0f-8009-3ce216e874cf with Priority: HIGHEST for action port [ 1051.449959] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfd9db02-c69c-4a0f-8009-3ce216e874cf with Priority: HIGHEST for action port [ 1051.450572] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfd9db02-c69c-4a0f-8009-3ce216e874cf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.450698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfd9db02-c69c-4a0f-8009-3ce216e874cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.450763] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfd9db02-c69c-4a0f-8009-3ce216e874cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.451259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfd9db02-c69c-4a0f-8009-3ce216e874cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.451383] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfd9db02-c69c-4a0f-8009-3ce216e874cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.954676] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bfd9db02-c69c-4a0f-8009-3ce216e874cf [ 1051.955125] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.955125] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.955125] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.955302] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.955373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.955645] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bfd9db02-c69c-4a0f-8009-3ce216e874cf already deleted. [ 1051.955645] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfd9db02-c69c-4a0f-8009-3ce216e874cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.113018] env[69559]: INFO networking_nsxv3.common.synchronization [None req-bce10035-b0e7-4170-92e1-9f83afc68958 None None] Enqueued Resource ID: 7e4511f6-111b-4f8d-b65a-a2ab858bcace with Priority: HIGHEST for action port [ 1052.113018] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e4511f6-111b-4f8d-b65a-a2ab858bcace with Priority: HIGHEST for action port [ 1052.113018] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e4511f6-111b-4f8d-b65a-a2ab858bcace taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.113018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e4511f6-111b-4f8d-b65a-a2ab858bcace" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.113018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e4511f6-111b-4f8d-b65a-a2ab858bcace" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.113632] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e4511f6-111b-4f8d-b65a-a2ab858bcace" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.113632] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e4511f6-111b-4f8d-b65a-a2ab858bcace',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.541125] env[69559]: INFO networking_nsxv3.common.synchronization [req-0c3b0f42-d55e-4806-a562-c8d307e422c3 req-767f0329-891d-49a3-8627-c72ee739fc81 tempest-ServerAddressesNegativeTestJSON-2056031491 tempest-ServerAddressesNegativeTestJSON-2056031491-project-member] Enqueued Resource ID: f1375255-0519-4538-bc3f-1cd9a0e0744c with Priority: HIGHEST for action security_group_members [ 1052.541744] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1375255-0519-4538-bc3f-1cd9a0e0744c with Priority: HIGHEST for action security_group_members [ 1052.541925] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1375255-0519-4538-bc3f-1cd9a0e0744c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.542057] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.542128] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.542314] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.542471] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.542639] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.542639] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.542857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.542952] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.543125] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1375255-0519-4538-bc3f-1cd9a0e0744c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.617036] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e4511f6-111b-4f8d-b65a-a2ab858bcace [ 1052.617036] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.617036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.617036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.617036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.617036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.617036] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e4511f6-111b-4f8d-b65a-a2ab858bcace already deleted. [ 1052.617036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e4511f6-111b-4f8d-b65a-a2ab858bcace" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.688479] env[69559]: INFO networking_nsxv3.common.synchronization [None req-b390650d-8180-4b0e-a868-895a60210a0a tempest-AttachVolumeTestJSON-949454441 tempest-AttachVolumeTestJSON-949454441-project-member] Enqueued Resource ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 with Priority: HIGHEST for action security_group_rules [ 1052.689454] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 with Priority: HIGHEST for action security_group_rules [ 1052.689818] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18ff4996-ee34-4aa9-8c27-09de3d4a6f74 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.689948] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.690027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.690606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.690606] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18ff4996-ee34-4aa9-8c27-09de3d4a6f74',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.788199] env[69559]: INFO networking_nsxv3.common.synchronization [None req-2e9d57e5-e5a8-442d-91a5-57ad04e18397 tempest-AttachVolumeTestJSON-949454441 tempest-AttachVolumeTestJSON-949454441-project-member] Enqueued Resource ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 with Priority: HIGHEST for action security_group_rules [ 1052.788199] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 with Priority: HIGHEST for action security_group_rules [ 1052.788199] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18ff4996-ee34-4aa9-8c27-09de3d4a6f74 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.788358] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.050436] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.050436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.050436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.050436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.050436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.050436] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.050436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.050436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.050436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.050436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.050436] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1375255-0519-4538-bc3f-1cd9a0e0744c is going to be updated. [ 1053.075367] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.075367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.075367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.075367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.075367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.084118] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1375255-0519-4538-bc3f-1cd9a0e0744c in Status: IN_PROGRESS for 2s [ 1053.226396] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.226396] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.226396] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.226396] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.226396] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.226396] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 already deleted. [ 1053.226396] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.226396] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.226396] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.226396] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18ff4996-ee34-4aa9-8c27-09de3d4a6f74',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.247023] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1053.247442] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.393762] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 1053.394063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.752515] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.752666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.752738] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.752953] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.753057] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.753193] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 already deleted. [ 1053.753222] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.109689] env[69559]: INFO networking_nsxv3.common.synchronization [None req-51d09775-455b-41aa-a7f4-79db664227f6 None None] Enqueued Resource ID: e651580c-49c3-4435-a4c4-2f020b86378c with Priority: HIGHEST for action port [ 1054.110252] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e651580c-49c3-4435-a4c4-2f020b86378c with Priority: HIGHEST for action port [ 1054.110634] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-e651580c-49c3-4435-a4c4-2f020b86378c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.110767] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e651580c-49c3-4435-a4c4-2f020b86378c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.110860] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e651580c-49c3-4435-a4c4-2f020b86378c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.111146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e651580c-49c3-4435-a4c4-2f020b86378c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.111294] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e651580c-49c3-4435-a4c4-2f020b86378c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.614838] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e651580c-49c3-4435-a4c4-2f020b86378c [ 1054.615278] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.615429] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.615502] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.615713] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.615801] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.615893] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e651580c-49c3-4435-a4c4-2f020b86378c already deleted. [ 1054.615973] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e651580c-49c3-4435-a4c4-2f020b86378c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.799202] env[69559]: INFO networking_nsxv3.common.synchronization [None req-c0c9ad49-f726-4956-a388-a970bac64686 tempest-AttachVolumeNegativeTest-1400300488 tempest-AttachVolumeNegativeTest-1400300488-project-member] Enqueued Resource ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 with Priority: HIGHEST for action security_group_rules [ 1054.799941] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 with Priority: HIGHEST for action security_group_rules [ 1054.800398] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3283394-46a2-4c04-8d8d-61fd36d02b80 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.800607] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.800727] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.801061] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.801207] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3283394-46a2-4c04-8d8d-61fd36d02b80',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.904728] env[69559]: INFO networking_nsxv3.common.synchronization [None req-a4782449-057b-41b8-8761-4278bd0338ff tempest-AttachVolumeNegativeTest-1400300488 tempest-AttachVolumeNegativeTest-1400300488-project-member] Enqueued Resource ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 with Priority: HIGHEST for action security_group_rules [ 1054.904728] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 with Priority: HIGHEST for action security_group_rules [ 1054.905013] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3283394-46a2-4c04-8d8d-61fd36d02b80 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.905275] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.092893] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1375255-0519-4538-bc3f-1cd9a0e0744c in Status: SUCCESS [ 1055.093088] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1375255-0519-4538-bc3f-1cd9a0e0744c deletion is rescheduled due to dependency. [ 1055.093208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.323140] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.323510] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.323510] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.323624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.323726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.323897] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 already deleted. [ 1055.323952] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.324112] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.324303] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.324389] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3283394-46a2-4c04-8d8d-61fd36d02b80',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.384207] env[69559]: INFO networking_nsxv3.common.synchronization [None req-b33e57c2-440f-4e09-8116-c66087262727 tempest-ImagesOneServerNegativeTestJSON-1590344667 tempest-ImagesOneServerNegativeTestJSON-1590344667-project-member] Enqueued Resource ID: 201b3c62-0ede-4868-91ed-f29184f225e9 with Priority: HIGHEST for action security_group_rules [ 1055.384207] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 201b3c62-0ede-4868-91ed-f29184f225e9 with Priority: HIGHEST for action security_group_rules [ 1055.384207] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-201b3c62-0ede-4868-91ed-f29184f225e9 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.384207] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-201b3c62-0ede-4868-91ed-f29184f225e9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.384207] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-201b3c62-0ede-4868-91ed-f29184f225e9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.384207] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-201b3c62-0ede-4868-91ed-f29184f225e9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.384207] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('201b3c62-0ede-4868-91ed-f29184f225e9',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.496604] env[69559]: INFO networking_nsxv3.common.synchronization [None req-012bcdb3-0ce5-4264-9324-d1b6d4ac619c tempest-ImagesOneServerNegativeTestJSON-1590344667 tempest-ImagesOneServerNegativeTestJSON-1590344667-project-member] Enqueued Resource ID: 201b3c62-0ede-4868-91ed-f29184f225e9 with Priority: HIGHEST for action security_group_rules [ 1055.497286] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 201b3c62-0ede-4868-91ed-f29184f225e9 with Priority: HIGHEST for action security_group_rules [ 1055.497689] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-201b3c62-0ede-4868-91ed-f29184f225e9 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.497814] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-201b3c62-0ede-4868-91ed-f29184f225e9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.845912] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.846104] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.846190] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.846433] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.846553] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.846689] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 already deleted. [ 1055.846762] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.906405] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.906405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.906405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.906750] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.907310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.907310] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 201b3c62-0ede-4868-91ed-f29184f225e9 already deleted. [ 1055.907310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-201b3c62-0ede-4868-91ed-f29184f225e9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.907310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-201b3c62-0ede-4868-91ed-f29184f225e9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.907527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-201b3c62-0ede-4868-91ed-f29184f225e9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.907527] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('201b3c62-0ede-4868-91ed-f29184f225e9',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.220818] env[69559]: INFO networking_nsxv3.common.synchronization [req-f7c7b7c1-c038-42f5-b36e-18dcdae071a1 req-e75b3895-9b4b-4394-b42b-02147996a9ba tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 1056.221406] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 1056.221763] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.221888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.222044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.222165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.222321] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.222419] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.222520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.222618] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.222702] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.222872] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.444438] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.444843] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.444843] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.444975] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.445076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.445200] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 201b3c62-0ede-4868-91ed-f29184f225e9 already deleted. [ 1056.445296] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-201b3c62-0ede-4868-91ed-f29184f225e9" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.507419] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.507646] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.507792] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.508142] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.508442] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.508637] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.508790] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.509097] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.509201] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.509444] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1056.509582] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1056.509756] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1056.509831] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1056.509971] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1056.510106] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1056.510244] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.533574] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.533832] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1056.534092] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.534352] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.534853] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-1dc1dbbd-ac42-4ae4-808f-72a56ebffb6e taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.535132] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-1dc1dbbd-ac42-4ae4-808f-72a56ebffb6e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.535320] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-1dc1dbbd-ac42-4ae4-808f-72a56ebffb6e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.535772] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-1dc1dbbd-ac42-4ae4-808f-72a56ebffb6e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.535990] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1dc1dbbd-ac42-4ae4-808f-72a56ebffb6e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.725641] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.725641] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.725641] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.725641] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.748214] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.748603] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.748742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.748847] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.749082] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.749849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.749849] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19282542-923d-4b29-8ce7-e30953449122 is going to be updated. [ 1056.771561] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.771881] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.771881] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.772028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.772418] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.780791] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: IN_PROGRESS for 2s [ 1057.038072] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.038330] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.038464] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.038759] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.038918] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.039091] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 1dc1dbbd-ac42-4ae4-808f-72a56ebffb6e not found, creating... [ 1057.039359] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.039772] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.039916] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.040161] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.040309] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.040723] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.040897] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.041219] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.041473] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.041688] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.041866] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 1dc1dbbd-ac42-4ae4-808f-72a56ebffb6e is going to be created. [ 1057.064615] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.064840] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.064972] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.065283] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.065520] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.065779] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-1dc1dbbd-ac42-4ae4-808f-72a56ebffb6e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.135852] env[69559]: INFO networking_nsxv3.common.synchronization [req-fc3e7f86-ae77-43b8-bf73-6abe3e48550b req-e5330117-1a29-4a58-90eb-3779d14e9932 tempest-ServerRescueNegativeTestJSON-1113411482 tempest-ServerRescueNegativeTestJSON-1113411482-project-member] Enqueued Resource ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b with Priority: HIGHEST for action security_group_members [ 1057.136793] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b with Priority: HIGHEST for action security_group_members [ 1057.136926] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.137219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.137279] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.137805] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.137965] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.138050] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.138085] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.138292] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.138345] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.138563] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a11f9ece-2d6a-48aa-bfa9-8e391de87f3b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.647021] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a11f9ece-2d6a-48aa-bfa9-8e391de87f3b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.743287] env[69559]: INFO networking_nsxv3.common.synchronization [req-f7c7b7c1-c038-42f5-b36e-18dcdae071a1 req-65ea97ea-d28e-4500-b0ab-0deedcffce43 service nova] Enqueued Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_rules [ 1057.743287] env[69559]: INFO networking_nsxv3.common.synchronization [req-f7c7b7c1-c038-42f5-b36e-18dcdae071a1 req-65ea97ea-d28e-4500-b0ab-0deedcffce43 service nova] Enqueued Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 1057.743287] env[69559]: INFO networking_nsxv3.common.synchronization [req-f7c7b7c1-c038-42f5-b36e-18dcdae071a1 req-65ea97ea-d28e-4500-b0ab-0deedcffce43 service nova] Enqueued Resource ID: 1dc1dbbd-ac42-4ae4-808f-72a56ebffb6e with Priority: HIGHEST for action port [ 1057.743287] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_rules [ 1057.743287] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 1057.743287] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dc1dbbd-ac42-4ae4-808f-72a56ebffb6e with Priority: HIGHEST for action port [ 1057.743287] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.743901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.744101] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.744405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.744677] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.745757] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.749092] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.749092] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-1dc1dbbd-ac42-4ae4-808f-72a56ebffb6e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.749321] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1dc1dbbd-ac42-4ae4-808f-72a56ebffb6e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.749321] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1dc1dbbd-ac42-4ae4-808f-72a56ebffb6e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.749370] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1dc1dbbd-ac42-4ae4-808f-72a56ebffb6e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.749462] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1dc1dbbd-ac42-4ae4-808f-72a56ebffb6e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.083280] env[69559]: INFO networking_nsxv3.common.synchronization [req-e8d61313-1301-4528-9704-78299d33a6b7 req-b3919302-2542-4a06-a563-5589137a3b9a tempest-InstanceActionsV221TestJSON-1356131586 tempest-InstanceActionsV221TestJSON-1356131586-project-member] Enqueued Resource ID: 5fa80a9f-7415-4f67-b83a-473ff443eaff with Priority: HIGHEST for action security_group_members [ 1058.083280] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fa80a9f-7415-4f67-b83a-473ff443eaff with Priority: HIGHEST for action security_group_members [ 1058.083583] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fa80a9f-7415-4f67-b83a-473ff443eaff taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.083909] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.084110] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.084550] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.084852] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.085109] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.085288] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.085621] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.085846] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.086069] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fa80a9f-7415-4f67-b83a-473ff443eaff',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.151419] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a11f9ece-2d6a-48aa-bfa9-8e391de87f3b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.251214] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.253038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.253038] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1dc1dbbd-ac42-4ae4-808f-72a56ebffb6e with status ACTIVE [ 1058.253038] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.253038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.253038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.253038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.253038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.253038] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.253410] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.253410] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.253410] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.253410] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.253573] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.253659] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.253776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.254538] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.254538] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.254538] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1dc1dbbd-ac42-4ae4-808f-72a56ebffb6e is going to be updated. [ 1058.278420] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.279212] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.279212] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.279212] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.279212] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.279212] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1dc1dbbd-ac42-4ae4-808f-72a56ebffb6e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.391662] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-209 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.391881] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-209" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.392016] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-209" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.392360] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-209" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.392632] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.392797] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.392963] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.393219] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.393369] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.393584] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1058.393705] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1058.393818] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1058.393930] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1058.394057] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1058.394171] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1058.394307] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1058.412706] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1058.412962] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1058.413147] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1058.413329] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-209" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.413637] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-8e13a404-7f51-485c-ac4d-b12c9e4f97cc taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.413815] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-8e13a404-7f51-485c-ac4d-b12c9e4f97cc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.413940] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-8e13a404-7f51-485c-ac4d-b12c9e4f97cc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.414300] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-8e13a404-7f51-485c-ac4d-b12c9e4f97cc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.414448] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e13a404-7f51-485c-ac4d-b12c9e4f97cc',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.588573] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.588796] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.588796] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.589022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.589115] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.589329] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.589450] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.589450] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.589602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.589674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.589827] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fa80a9f-7415-4f67-b83a-473ff443eaff already deleted. [ 1058.589827] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.653395] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.653395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.653795] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.653795] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.653928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.654053] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b is going to be updated. [ 1058.684902] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.685061] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.685136] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.685349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.685492] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.695202] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b in Status: IN_PROGRESS for 2s [ 1058.793116] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: SUCCESS [ 1058.793116] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19282542-923d-4b29-8ce7-e30953449122 deletion is rescheduled due to dependency. [ 1058.793116] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.793116] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.793303] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.793522] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.793689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.793778] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.793981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.794106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.794240] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.917112] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.917360] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.917495] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.917788] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.917952] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.918134] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 8e13a404-7f51-485c-ac4d-b12c9e4f97cc not found, creating... [ 1058.918400] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.920475] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.920475] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.920475] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.920475] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.920475] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.920475] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.920475] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.920475] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.920475] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.920475] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 8e13a404-7f51-485c-ac4d-b12c9e4f97cc is going to be created. [ 1058.939593] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.942532] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.942532] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.942532] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.942532] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.942532] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-8e13a404-7f51-485c-ac4d-b12c9e4f97cc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.296290] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.609248] env[69559]: INFO networking_nsxv3.common.synchronization [req-e8d61313-1301-4528-9704-78299d33a6b7 req-77f7a8a0-12d4-48e6-8a29-b445e819332b service nova] Enqueued Resource ID: 5fa80a9f-7415-4f67-b83a-473ff443eaff with Priority: HIGHEST for action security_group_rules [ 1059.609441] env[69559]: INFO networking_nsxv3.common.synchronization [req-e8d61313-1301-4528-9704-78299d33a6b7 req-77f7a8a0-12d4-48e6-8a29-b445e819332b service nova] Enqueued Resource ID: 5fa80a9f-7415-4f67-b83a-473ff443eaff with Priority: HIGHEST for action security_group_members [ 1059.609539] env[69559]: INFO networking_nsxv3.common.synchronization [req-e8d61313-1301-4528-9704-78299d33a6b7 req-77f7a8a0-12d4-48e6-8a29-b445e819332b service nova] Enqueued Resource ID: 8e13a404-7f51-485c-ac4d-b12c9e4f97cc with Priority: HIGHEST for action port [ 1059.609790] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fa80a9f-7415-4f67-b83a-473ff443eaff with Priority: HIGHEST for action security_group_rules [ 1059.609912] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fa80a9f-7415-4f67-b83a-473ff443eaff with Priority: HIGHEST for action security_group_members [ 1059.610016] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e13a404-7f51-485c-ac4d-b12c9e4f97cc with Priority: HIGHEST for action port [ 1059.610627] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fa80a9f-7415-4f67-b83a-473ff443eaff taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.610754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.610787] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.611314] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.611472] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fa80a9f-7415-4f67-b83a-473ff443eaff',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.612444] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fa80a9f-7415-4f67-b83a-473ff443eaff taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.612608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.612736] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.612931] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.613133] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.613278] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.613375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.613585] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.613727] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.613874] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fa80a9f-7415-4f67-b83a-473ff443eaff',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.614901] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e13a404-7f51-485c-ac4d-b12c9e4f97cc taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.615083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e13a404-7f51-485c-ac4d-b12c9e4f97cc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.615197] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e13a404-7f51-485c-ac4d-b12c9e4f97cc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.615385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e13a404-7f51-485c-ac4d-b12c9e4f97cc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.615503] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e13a404-7f51-485c-ac4d-b12c9e4f97cc',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.798486] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.906129] env[69559]: INFO networking_nsxv3.common.synchronization [req-71c22e9e-6810-4481-bd61-dd611477e21a req-92205638-c435-4d6e-8d3c-9c343791d58f tempest-DeleteServersTestJSON-1423597435 tempest-DeleteServersTestJSON-1423597435-project-member] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 1059.907026] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 1059.907385] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.907498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.907583] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.907810] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.907987] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.908311] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.908391] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.908633] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.908741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.908866] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.120018] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fa80a9f-7415-4f67-b83a-473ff443eaff taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.120018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.120018] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5fa80a9f-7415-4f67-b83a-473ff443eaff',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.120018] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e13a404-7f51-485c-ac4d-b12c9e4f97cc with status ACTIVE [ 1060.120018] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.120018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.120018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.120018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.120018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.120018] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.120018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.120018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.120018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.120018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.120611] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.120611] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.120611] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.120611] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.120611] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.120749] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e13a404-7f51-485c-ac4d-b12c9e4f97cc is going to be updated. [ 1060.143594] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.143594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.143594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.143754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.144094] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.144094] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e13a404-7f51-485c-ac4d-b12c9e4f97cc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.301177] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.301341] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.301411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.301649] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.301752] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.301855] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19282542-923d-4b29-8ce7-e30953449122 is going to be updated. [ 1060.355038] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.355038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.355038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.355038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.355038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.361435] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: IN_PROGRESS for 2s [ 1060.410804] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.411055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.411150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.411412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.411805] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.411805] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.411977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.411977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.412101] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.412165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.412253] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be updated. [ 1060.422990] env[69559]: INFO networking_nsxv3.common.synchronization [req-ed52caa9-18ca-4bd9-a7b5-65a5ea29bbc9 req-5862056c-c3bc-4d34-8c0e-6e96adbd446a tempest-ServerActionsTestOtherB-703157979 tempest-ServerActionsTestOtherB-703157979-project-member] Enqueued Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_members [ 1060.423518] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_members [ 1060.423822] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-64914acb-965b-4269-aaa5-676103c45a62 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.423941] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.424017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.424208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.424361] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.424446] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.424511] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.424653] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.424738] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.424825] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.440870] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.442165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.442291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.442507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.442662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.455762] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 1060.623292] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5fa80a9f-7415-4f67-b83a-473ff443eaff',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.709206] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b in Status: SUCCESS [ 1060.709206] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.927197] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.927659] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.927659] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.927659] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.949268] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.949268] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.949268] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.949268] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.949268] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.949268] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.949268] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64914acb-965b-4269-aaa5-676103c45a62 is going to be updated. [ 1060.972376] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.973809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.973809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.975057] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.975057] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.983540] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: IN_PROGRESS for 2s [ 1061.127728] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.127849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.127921] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.128164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.128270] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.128370] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fa80a9f-7415-4f67-b83a-473ff443eaff is going to be created. [ 1061.156444] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.156585] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.156653] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.156870] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.157036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.165524] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fa80a9f-7415-4f67-b83a-473ff443eaff in Status: UNINITIALIZED for 2s [ 1062.416200] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: SUCCESS [ 1062.416478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.416597] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.416808] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.417009] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.417135] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.417199] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.417348] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.417431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.417572] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.417602] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.470466] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 1062.470895] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d deletion is rescheduled due to dependency. [ 1062.471162] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.693121] env[69559]: INFO networking_nsxv3.common.synchronization [None req-1ac27d1f-e062-48aa-b9d3-8a26402b16c4 tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 1062.694038] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 1062.694328] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.694595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.694595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.694926] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.695692] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.695692] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.695692] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.695692] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.695692] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.695692] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.919584] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.919715] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.994135] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: SUCCESS [ 1062.994335] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64914acb-965b-4269-aaa5-676103c45a62 deletion is rescheduled due to dependency. [ 1062.994556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.179369] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fa80a9f-7415-4f67-b83a-473ff443eaff in Status: SUCCESS [ 1063.179583] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.179749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.179968] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.180181] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.180572] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.180666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.180847] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.180924] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.181029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.181119] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5fa80a9f-7415-4f67-b83a-473ff443eaff',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.198857] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.683843] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fa80a9f-7415-4f67-b83a-473ff443eaff taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.684242] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.684242] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.684402] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.684780] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.684911] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.684977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.685154] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.685236] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.685321] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.685467] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fa80a9f-7415-4f67-b83a-473ff443eaff taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.685559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.685621] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.685758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.685892] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.686159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.686159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.686220] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.686248] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.686334] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.686417] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5fa80a9f-7415-4f67-b83a-473ff443eaff',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.701689] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.189157] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5fa80a9f-7415-4f67-b83a-473ff443eaff: rpc.has_security_group_logging(os_id): False [ 1064.204342] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.204499] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.204560] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.204791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.204886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.205035] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19282542-923d-4b29-8ce7-e30953449122 is going to be updated. [ 1064.206860] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.207040] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.207040] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.207216] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.207301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.207529] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.207632] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.207632] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.207748] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.207817] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.208019] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.208153] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.208186] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.208293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.208369] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.208584] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.208662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.208738] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.208862] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.208932] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.209042] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fa80a9f-7415-4f67-b83a-473ff443eaff is going to be created. [ 1064.238341] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.238597] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.238677] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.238889] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.239044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.248700] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: IN_PROGRESS for 2s [ 1064.271407] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.271569] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.271694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.271857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.272067] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.282953] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fa80a9f-7415-4f67-b83a-473ff443eaff in Status: IN_PROGRESS for 2s [ 1064.690081] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.690444] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.690444] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.690602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.690720] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.795662] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.795845] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.796047] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.796383] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.796694] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.796916] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.797105] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.797368] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.797596] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.797911] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.798064] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1064.798258] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1064.798422] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1064.798591] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.798744] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1064.798931] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1064.817377] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1064.817570] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1064.817717] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1064.817897] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.818247] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-55beb26a-9d15-41a0-8889-f9cc88e19f07 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.818435] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-55beb26a-9d15-41a0-8889-f9cc88e19f07" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.818587] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-55beb26a-9d15-41a0-8889-f9cc88e19f07" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.818917] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-55beb26a-9d15-41a0-8889-f9cc88e19f07" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.819077] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55beb26a-9d15-41a0-8889-f9cc88e19f07',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.133392] env[69559]: INFO networking_nsxv3.common.synchronization [req-0fe80b1a-e22a-48d5-a847-b22b87c85662 req-a3348e80-9367-44e2-a3d5-2918576e7c50 tempest-ServerTagsTestJSON-1422397021 tempest-ServerTagsTestJSON-1422397021-project-member] Enqueued Resource ID: 92121496-4d0a-4f2f-b08f-e4603b279788 with Priority: HIGHEST for action security_group_members [ 1065.133942] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92121496-4d0a-4f2f-b08f-e4603b279788 with Priority: HIGHEST for action security_group_members [ 1065.134495] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-92121496-4d0a-4f2f-b08f-e4603b279788 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.134495] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.134495] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.134675] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.134830] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.134929] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.134990] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.135188] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.135273] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.135365] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92121496-4d0a-4f2f-b08f-e4603b279788',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.192872] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.321338] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.321584] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.321743] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.322046] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.322339] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.322398] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 55beb26a-9d15-41a0-8889-f9cc88e19f07 not found, creating... [ 1065.322993] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.322993] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.322993] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.323200] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.323348] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.323638] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.323804] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.323927] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.324227] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.324390] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.324563] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 55beb26a-9d15-41a0-8889-f9cc88e19f07 is going to be created. [ 1065.342065] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.342272] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.342402] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.342694] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.342954] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.343199] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-55beb26a-9d15-41a0-8889-f9cc88e19f07" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.400820] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.401025] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-36" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.401161] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-36" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.401484] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-36" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.401750] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.401945] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.402090] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.402319] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.402467] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.402679] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1065.402800] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.402987] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.403126] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.403246] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1065.403398] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.403590] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.428570] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.428737] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1065.428879] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.429066] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-36" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.429410] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-7b884048-43c7-4063-a86b-6751469a5a8c taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.429589] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-7b884048-43c7-4063-a86b-6751469a5a8c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.429721] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-7b884048-43c7-4063-a86b-6751469a5a8c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.430016] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-7b884048-43c7-4063-a86b-6751469a5a8c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.430166] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b884048-43c7-4063-a86b-6751469a5a8c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.639127] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.639370] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.639477] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.639790] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.639929] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.640233] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.640374] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.640468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.640734] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.640832] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.640950] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92121496-4d0a-4f2f-b08f-e4603b279788 already deleted. [ 1065.641066] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.695611] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.932155] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.932367] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.933033] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.933033] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.933033] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.933156] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 7b884048-43c7-4063-a86b-6751469a5a8c not found, creating... [ 1065.933351] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.933515] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.933640] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.933862] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.934016] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.934305] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.934649] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.934649] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.934786] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.934954] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.935118] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 7b884048-43c7-4063-a86b-6751469a5a8c is going to be created. [ 1065.975054] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.975054] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.975054] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.975054] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.975054] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.975054] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-7b884048-43c7-4063-a86b-6751469a5a8c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.028967] env[69559]: INFO networking_nsxv3.common.synchronization [req-cd3c4e66-1695-4aaf-ba6a-45a3af554d1c req-0641978e-262a-46e7-9b2a-91e87d0ad4dd service nova] Enqueued Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_rules [ 1066.029172] env[69559]: INFO networking_nsxv3.common.synchronization [req-cd3c4e66-1695-4aaf-ba6a-45a3af554d1c req-0641978e-262a-46e7-9b2a-91e87d0ad4dd service nova] Enqueued Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 1066.029320] env[69559]: INFO networking_nsxv3.common.synchronization [req-cd3c4e66-1695-4aaf-ba6a-45a3af554d1c req-0641978e-262a-46e7-9b2a-91e87d0ad4dd service nova] Enqueued Resource ID: 55beb26a-9d15-41a0-8889-f9cc88e19f07 with Priority: HIGHEST for action port [ 1066.029850] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_rules [ 1066.029982] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 1066.030095] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55beb26a-9d15-41a0-8889-f9cc88e19f07 with Priority: HIGHEST for action port [ 1066.030374] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.030518] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.030734] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.030829] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.031025] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-55beb26a-9d15-41a0-8889-f9cc88e19f07 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.031155] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55beb26a-9d15-41a0-8889-f9cc88e19f07" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.031193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55beb26a-9d15-41a0-8889-f9cc88e19f07" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.031368] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55beb26a-9d15-41a0-8889-f9cc88e19f07" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.031443] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55beb26a-9d15-41a0-8889-f9cc88e19f07',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.198353] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1066.198353] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1066.260802] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: SUCCESS [ 1066.261060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.261247] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.261468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.261682] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.261789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.261855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.262008] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.262096] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.262182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.262341] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.262419] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.262480] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.262618] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.262754] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.262846] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.262908] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.263061] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.263134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.263214] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.263297] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.264123] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.264287] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.264430] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.265358] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.265358] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.265358] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.265358] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.265358] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.295999] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fa80a9f-7415-4f67-b83a-473ff443eaff in Status: SUCCESS [ 1066.296326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.535032] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55beb26a-9d15-41a0-8889-f9cc88e19f07 with status ACTIVE [ 1066.535415] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.536295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.536480] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.541022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.541022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.541022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.541022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.541022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.541022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.541022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.541022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.541022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.541022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.541022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.541022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.541022] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55beb26a-9d15-41a0-8889-f9cc88e19f07 is going to be updated. [ 1066.569045] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.569512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.569682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.569975] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.570217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.570458] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55beb26a-9d15-41a0-8889-f9cc88e19f07" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.617397] env[69559]: INFO networking_nsxv3.common.synchronization [req-0fe80b1a-e22a-48d5-a847-b22b87c85662 req-c6f195c5-9833-4197-920b-2699d631509c service nova] Enqueued Resource ID: 92121496-4d0a-4f2f-b08f-e4603b279788 with Priority: HIGHEST for action security_group_rules [ 1066.617397] env[69559]: INFO networking_nsxv3.common.synchronization [req-0fe80b1a-e22a-48d5-a847-b22b87c85662 req-c6f195c5-9833-4197-920b-2699d631509c service nova] Enqueued Resource ID: 92121496-4d0a-4f2f-b08f-e4603b279788 with Priority: HIGHEST for action security_group_members [ 1066.617397] env[69559]: INFO networking_nsxv3.common.synchronization [req-0fe80b1a-e22a-48d5-a847-b22b87c85662 req-c6f195c5-9833-4197-920b-2699d631509c service nova] Enqueued Resource ID: 7b884048-43c7-4063-a86b-6751469a5a8c with Priority: HIGHEST for action port [ 1066.617397] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92121496-4d0a-4f2f-b08f-e4603b279788 with Priority: HIGHEST for action security_group_rules [ 1066.617397] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92121496-4d0a-4f2f-b08f-e4603b279788 with Priority: HIGHEST for action security_group_members [ 1066.617397] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b884048-43c7-4063-a86b-6751469a5a8c with Priority: HIGHEST for action port [ 1066.617397] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92121496-4d0a-4f2f-b08f-e4603b279788 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.617397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.617397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.617397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.617397] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92121496-4d0a-4f2f-b08f-e4603b279788',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.618638] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-92121496-4d0a-4f2f-b08f-e4603b279788 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.618762] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.618825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.619053] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.619524] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.622054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.622054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.622054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.622054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.622054] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92121496-4d0a-4f2f-b08f-e4603b279788',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.622054] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b884048-43c7-4063-a86b-6751469a5a8c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.622054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b884048-43c7-4063-a86b-6751469a5a8c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.622054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b884048-43c7-4063-a86b-6751469a5a8c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.622054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b884048-43c7-4063-a86b-6751469a5a8c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.622054] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b884048-43c7-4063-a86b-6751469a5a8c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.766894] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19282542-923d-4b29-8ce7-e30953449122: rpc.has_security_group_logging(os_id): False [ 1066.768114] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.788967] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.789303] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.789433] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.789586] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.789742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.789957] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.790098] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.790146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.790312] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.790414] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.790561] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.790713] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.790767] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.790920] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.791020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.791227] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.791424] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.791424] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.791573] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.791643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.791764] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19282542-923d-4b29-8ce7-e30953449122 is going to be updated. [ 1066.867767] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.867984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.868102] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.868350] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.868578] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.879119] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: IN_PROGRESS for 2s [ 1067.129064] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-92121496-4d0a-4f2f-b08f-e4603b279788 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.129184] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.129364] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b884048-43c7-4063-a86b-6751469a5a8c with status ACTIVE [ 1067.129568] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.129655] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.129684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.129898] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.129969] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.130365] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.130365] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.130365] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.130497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.130719] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.130803] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.130884] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.130931] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.131090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.131147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.131215] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b884048-43c7-4063-a86b-6751469a5a8c is going to be updated. [ 1067.132139] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92121496-4d0a-4f2f-b08f-e4603b279788',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.155572] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.155717] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.155766] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.155970] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.156165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.156357] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b884048-43c7-4063-a86b-6751469a5a8c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.183495] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.183654] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.183692] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.183881] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.197014] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1067.200322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.200322] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1067.248147] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.248294] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.248358] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.248775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.260538] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.261351] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1067.261433] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1067.261525] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1067.270223] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.322766] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.322942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.323039] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.323229] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.324609] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.324789] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1067.423860] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.424027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.424097] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.424394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.424600] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.424859] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1067.497382] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.497612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.497714] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.498054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.498543] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.498866] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:52. [ 1067.498973] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'9bd39e16-65ec-4813-afc3-35754d24a5bf', '531bc278-c746-4ada-9fc4-704b99519eae', '89a65a81-7e5b-4da0-99ae-af95bd9df589', 'acb5a9fe-3650-403a-90f4-19ec52b5f97e', 'f1375255-0519-4538-bc3f-1cd9a0e0744c', '734f0202-8a2d-48a6-8b16-336653a0c857', '2b4e023e-3f17-4641-b235-16fa1645d85a', '19282542-923d-4b29-8ce7-e30953449122', 'f12ab78c-28a7-4f2b-a14e-b0a92a64233f', '858bd0a1-9ee5-49c8-ac77-f218758ad913', 'ebf5f404-8f48-487f-b212-72786dc389e8', '162b0750-9392-4d6d-b97a-5ce01d5e0894', '4c0b6c4f-ae6a-4f68-8883-90c34a375fc7', 'c7f662d8-9904-44e6-8a35-051e2c4e15cf', '51f74e50-136f-49a9-8456-6841ae996220', '38ad73d3-d173-4ff2-9e1d-72777311ba4d', '1feb63ae-217d-4dd9-89fc-3bc266674292', '73e98fb7-5118-4cdb-830b-497719ecfad4', '392028d0-93e9-4420-8ca7-d3fa218b5c83', '233eac4d-0cf7-44e3-b0cf-9c09c50ed577', '50135ff4-8447-455b-b0a1-ca85f9b5ef55', '99092389-59da-4e36-9a78-d2e1e7edec3e', 'ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05', '39b15e36-c638-4ca0-a065-67c76e8f79fe', '64914acb-965b-4269-aaa5-676103c45a62', '2bb1158b-fef7-4aa2-82e3-14d38a93d9b2', 'cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6', '55a5191b-a436-4df6-a235-6b2c46e6eea7', '868ef973-ca6a-480b-be75-839232b752db', 'd2e65fdd-c8b6-417a-a531-e6273e09a7c2', '40991716-c8be-41b4-b8c7-a3774f7dac8e', '825fa80b-a9de-4b97-ae04-49c19c2e9faa', '839ae40b-5f13-4259-8e2a-b943b206557d', '7fab5e96-3f01-4c71-994f-69059ca62986', '039c805f-b0b4-4b54-b42e-9f95c1e21442', 'cbcf9733-e0a4-4cd5-bcff-a59904ddee14', 'ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78', 'a4e0cfba-8016-40f3-90aa-98a94645d23c', '28190eb0-e154-4896-a918-a81b5035d7b6', 'a9b79819-0a51-4cc6-8e3e-f823f0b89406', 'e29c3806-d806-4df2-8a52-0ecf9da87984', '67da4308-465f-4939-8941-41bacf52a39e', 'a11f9ece-2d6a-48aa-bfa9-8e391de87f3b', 'dbe866c5-e7b8-4862-b37c-6b17f875f07e', 'e2d4f121-303e-4c6b-ac7a-e595df5750d8', '362fb317-5783-4d37-bba5-4e590ce7111d', '7d3ab8f7-3874-4370-9e84-4a90ecd908d1', 'c225ff1a-79ed-4da1-ac55-3b8ee41f70a5', '71804139-4bc8-4998-a537-3cd9da947efb', '5fa80a9f-7415-4f67-b83a-473ff443eaff', '54038215-926d-4af7-820c-4eb952c9aac0', 'b5e555cc-4bc4-4e59-b77f-deda078818fb'} {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1067.499090] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1067.517107] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.517282] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.517346] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.517513] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.517599] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.517706] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1067.517776] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1067.517845] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1067.587380] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.587579] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.587623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.587809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.589054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.589341] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1067.589512] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1067.589512] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1067.589593] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1067.589619] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/52 resources of Type:Security Group Rules [ 1067.589711] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf with Priority: HIGH for action security_group_rules [ 1067.589799] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGH for action security_group_rules [ 1067.589867] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 with Priority: HIGH for action security_group_rules [ 1067.589928] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e with Priority: HIGH for action security_group_rules [ 1067.589989] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f1375255-0519-4538-bc3f-1cd9a0e0744c with Priority: HIGH for action security_group_rules [ 1067.590056] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 734f0202-8a2d-48a6-8b16-336653a0c857 with Priority: HIGH for action security_group_rules [ 1067.590116] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGH for action security_group_rules [ 1067.590174] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGH for action security_group_rules [ 1067.590234] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f with Priority: HIGH for action security_group_rules [ 1067.590294] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 with Priority: HIGH for action security_group_rules [ 1067.590354] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGH for action security_group_rules [ 1067.590414] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 with Priority: HIGH for action security_group_rules [ 1067.590475] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 with Priority: HIGH for action security_group_rules [ 1067.590535] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGH for action security_group_rules [ 1067.590733] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 51f74e50-136f-49a9-8456-6841ae996220 with Priority: HIGH for action security_group_rules [ 1067.590733] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGH for action security_group_rules [ 1067.590733] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 with Priority: HIGH for action security_group_rules [ 1067.590812] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 with Priority: HIGH for action security_group_rules [ 1067.590842] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGH for action security_group_rules [ 1067.590909] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 with Priority: HIGH for action security_group_rules [ 1067.590993] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.634645] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92121496-4d0a-4f2f-b08f-e4603b279788',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.648752] env[69559]: INFO networking_nsxv3.common.synchronization [req-b841694e-1f59-4d59-a547-7a388ee71498 req-dd1b61e9-cdfb-436e-b114-9624d95c72ed tempest-ServersNegativeTestJSON-583757154 tempest-ServersNegativeTestJSON-583757154-project-member] Enqueued Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGHEST for action security_group_members [ 1067.649389] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGHEST for action security_group_members [ 1067.649537] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf with Priority: HIGH for action security_group_rules [ 1067.649640] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 with Priority: HIGH for action security_group_rules [ 1067.649738] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGH for action security_group_rules [ 1067.649831] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51f74e50-136f-49a9-8456-6841ae996220 with Priority: HIGH for action security_group_rules [ 1067.649920] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 with Priority: HIGH for action security_group_rules [ 1067.650013] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 with Priority: HIGH for action security_group_rules [ 1067.650107] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 with Priority: HIGH for action security_group_rules [ 1067.650193] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 with Priority: HIGH for action security_group_rules [ 1067.650278] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf with Priority: HIGH for action security_group_rules [ 1067.650362] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d with Priority: HIGH for action security_group_rules [ 1067.650447] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 with Priority: HIGH for action security_group_rules [ 1067.650531] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 with Priority: HIGH for action security_group_rules [ 1067.650698] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGH for action security_group_rules [ 1067.650774] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 with Priority: HIGH for action security_group_rules [ 1067.650856] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f with Priority: HIGH for action security_group_rules [ 1067.650937] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 734f0202-8a2d-48a6-8b16-336653a0c857 with Priority: HIGH for action security_group_rules [ 1067.651030] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGH for action security_group_rules [ 1067.651117] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1375255-0519-4538-bc3f-1cd9a0e0744c with Priority: HIGH for action security_group_rules [ 1067.651199] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGH for action security_group_rules [ 1067.651283] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e with Priority: HIGH for action security_group_rules [ 1067.651987] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.652131] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.652199] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.652396] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.652552] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.652657] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.652741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.652922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.653119] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.653221] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.653970] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9bd39e16-65ec-4813-afc3-35754d24a5bf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.654086] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.654151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.654321] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.654396] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9bd39e16-65ec-4813-afc3-35754d24a5bf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.655111] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89a65a81-7e5b-4da0-99ae-af95bd9df589 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.655218] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.655281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.655425] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.655495] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89a65a81-7e5b-4da0-99ae-af95bd9df589',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.656185] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.656250] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.656313] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.656456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.656525] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.657190] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51f74e50-136f-49a9-8456-6841ae996220 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.657342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.657381] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.657511] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.657613] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51f74e50-136f-49a9-8456-6841ae996220',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.658347] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-233eac4d-0cf7-44e3-b0cf-9c09c50ed577 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.658455] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.658524] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.658666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.658735] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('233eac4d-0cf7-44e3-b0cf-9c09c50ed577',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.659639] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-392028d0-93e9-4420-8ca7-d3fa218b5c83 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.659639] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.659639] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.659856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.659856] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('392028d0-93e9-4420-8ca7-d3fa218b5c83',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.660468] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73e98fb7-5118-4cdb-830b-497719ecfad4 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.660572] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.660677] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.660827] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.660897] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73e98fb7-5118-4cdb-830b-497719ecfad4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.661559] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1feb63ae-217d-4dd9-89fc-3bc266674292 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.661667] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.661756] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.661927] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.661999] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1feb63ae-217d-4dd9-89fc-3bc266674292',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.662781] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7f662d8-9904-44e6-8a35-051e2c4e15cf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.662897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.662964] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.663136] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.663225] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7f662d8-9904-44e6-8a35-051e2c4e15cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.663923] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.664040] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.664107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.664248] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.664318] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38ad73d3-d173-4ff2-9e1d-72777311ba4d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.664973] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.665094] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.665157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.665319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.665401] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c0b6c4f-ae6a-4f68-8883-90c34a375fc7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.667893] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-162b0750-9392-4d6d-b97a-5ce01d5e0894 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.668020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.668093] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.668263] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.668388] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('162b0750-9392-4d6d-b97a-5ce01d5e0894',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.669217] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.669380] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.669482] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.669707] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.669827] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.670793] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-858bd0a1-9ee5-49c8-ac77-f218758ad913 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.670942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.671055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.671293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.671413] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('858bd0a1-9ee5-49c8-ac77-f218758ad913',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.672370] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f12ab78c-28a7-4f2b-a14e-b0a92a64233f taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.672515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.676017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.676017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.676017] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f12ab78c-28a7-4f2b-a14e-b0a92a64233f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.676017] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-734f0202-8a2d-48a6-8b16-336653a0c857 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.676017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.676017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.676017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.676017] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('734f0202-8a2d-48a6-8b16-336653a0c857',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.676017] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.676017] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.676454] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1375255-0519-4538-bc3f-1cd9a0e0744c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.676454] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.676454] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.676643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.676716] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1375255-0519-4538-bc3f-1cd9a0e0744c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.677846] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-531bc278-c746-4ada-9fc4-704b99519eae taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.677978] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.678084] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.678278] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.678376] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.679365] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.679498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.679587] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.679809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.679942] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('acb5a9fe-3650-403a-90f4-19ec52b5f97e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.772962] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.773375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.773375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.773570] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.773695] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.773820] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19282542-923d-4b29-8ce7-e30953449122 is going to be updated. [ 1067.801826] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.802071] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.802148] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.802414] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.802734] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.810185] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: IN_PROGRESS for 2s [ 1068.139084] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.139238] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.139308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.139524] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.139612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.139815] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92121496-4d0a-4f2f-b08f-e4603b279788 is going to be created. [ 1068.187265] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.187408] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.187464] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.187711] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.187876] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.187976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.188050] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.188207] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.188291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.188374] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.188461] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.194704] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.194811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.194870] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.195285] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.213138] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.213281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.213351] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.213559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.213721] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.213816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.213877] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.214025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.214110] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.214185] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.214322] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.214415] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.214481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.214601] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.214821] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.214902] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.214960] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.215108] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.215182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.215263] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.215347] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.216665] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-531bc278-c746-4ada-9fc4-704b99519eae taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.216855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.216946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.217148] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.217297] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.217390] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.217452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.217587] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.217701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.217760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.217838] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.226234] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.226388] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.226468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.226707] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.226885] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.308985] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.309161] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.310394] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.310547] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.311643] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.311816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.312862] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.313029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.314032] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.314168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.315174] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.315306] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.316324] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.316454] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.317424] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.317572] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.318549] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.318697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.320112] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.320112] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.320630] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.321077] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.321197] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.332719] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.333159] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92121496-4d0a-4f2f-b08f-e4603b279788 in Status: UNINITIALIZED for 2s [ 1068.347517] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.348118] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.348254] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.349562] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.349562] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.349562] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.349838] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.350134] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.350233] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.354018] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.354018] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.354018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.354018] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.354018] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.354018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.354018] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.354413] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.354413] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.355137] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.355582] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.355849] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.356044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.356144] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.356365] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.356467] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.356611] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 is going to be updated. [ 1068.357725] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.357936] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.376575] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.376716] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73e98fb7-5118-4cdb-830b-497719ecfad4 is going to be deleted. [ 1068.377732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.377984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.391149] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.391343] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.391413] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.391645] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.391809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.401642] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 in Status: IN_PROGRESS for 2s [ 1068.402035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.402154] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b4e023e-3f17-4641-b235-16fa1645d85a is going to be deleted. [ 1068.402989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.403213] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.421148] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.421332] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51f74e50-136f-49a9-8456-6841ae996220 is going to be deleted. [ 1068.422189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.422394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.429076] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.429076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.444867] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.444867] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 734f0202-8a2d-48a6-8b16-336653a0c857 is going to be deleted. [ 1068.445535] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.445777] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.456129] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.456129] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.482020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.482020] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9bd39e16-65ec-4813-afc3-35754d24a5bf is going to be deleted. [ 1068.482020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.482020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.503803] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.503803] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.565744] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.565873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.595170] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.595305] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 233eac4d-0cf7-44e3-b0cf-9c09c50ed577 is going to be deleted. [ 1068.596251] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.596831] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.600425] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.600548] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.644397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.645628] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1feb63ae-217d-4dd9-89fc-3bc266674292 is going to be deleted. [ 1068.647284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.647284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.716201] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.716327] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7f662d8-9904-44e6-8a35-051e2c4e15cf is going to be deleted. [ 1068.717246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.717465] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.724056] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebf5f404-8f48-487f-b212-72786dc389e8: rpc.has_security_group_logging(os_id): False [ 1068.729304] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.765722] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.765860] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: acb5a9fe-3650-403a-90f4-19ec52b5f97e is going to be deleted. [ 1068.766797] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.767014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.791443] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.791776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.806238] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.806358] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c0b6c4f-ae6a-4f68-8883-90c34a375fc7 is going to be deleted. [ 1068.807293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.807522] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.813723] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.813723] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.840698] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.840844] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.856949] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.857184] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.896604] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.896769] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.905746] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: SUCCESS [ 1068.905746] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.905746] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.905746] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.905746] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.916039] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.916039] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1375255-0519-4538-bc3f-1cd9a0e0744c is going to be deleted. [ 1068.916218] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.916547] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.986871] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.986871] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38ad73d3-d173-4ff2-9e1d-72777311ba4d is going to be deleted. [ 1068.986871] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.986871] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.036125] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.036125] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89a65a81-7e5b-4da0-99ae-af95bd9df589 is going to be deleted. [ 1069.036125] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.036125] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.067251] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.067762] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.075592] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.075919] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.082279] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.082279] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 162b0750-9392-4d6d-b97a-5ce01d5e0894 is going to be deleted. [ 1069.082279] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.082279] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.114039] env[69559]: INFO networking_nsxv3.common.synchronization [req-90c3d4c2-a7f2-4e32-b9ed-7e38228d910d req-91af28f7-4eac-4454-bee5-08039464e01e tempest-InstanceActionsV221TestJSON-1356131586 tempest-InstanceActionsV221TestJSON-1356131586-project-member] Enqueued Resource ID: 5fa80a9f-7415-4f67-b83a-473ff443eaff with Priority: HIGHEST for action security_group_members [ 1069.114039] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fa80a9f-7415-4f67-b83a-473ff443eaff with Priority: HIGHEST for action security_group_members [ 1069.114888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.115203] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 858bd0a1-9ee5-49c8-ac77-f218758ad913 is going to be deleted. [ 1069.116325] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fa80a9f-7415-4f67-b83a-473ff443eaff taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.116614] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.116797] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.117111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.117418] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.117763] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.119018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.119018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.119018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.119018] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fa80a9f-7415-4f67-b83a-473ff443eaff',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.119857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.122550] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.176010] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.176157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.177940] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.178092] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 392028d0-93e9-4420-8ca7-d3fa218b5c83 is going to be deleted. [ 1069.179179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.179385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.218749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.219010] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f12ab78c-28a7-4f2b-a14e-b0a92a64233f is going to be deleted. [ 1069.219759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.220071] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.220071] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.220161] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73e98fb7-5118-4cdb-830b-497719ecfad4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.220305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.220455] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.220535] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.220696] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.221146] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.221304] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.221385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.221498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51f74e50-136f-49a9-8456-6841ae996220" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.221961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.221961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.221961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.222155] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-734f0202-8a2d-48a6-8b16-336653a0c857" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.222220] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.222312] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.222388] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.222498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9bd39e16-65ec-4813-afc3-35754d24a5bf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.223210] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.223308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.223377] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.223523] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.223602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.223714] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89a65a81-7e5b-4da0-99ae-af95bd9df589" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.223914] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.223968] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.224046] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.224156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-233eac4d-0cf7-44e3-b0cf-9c09c50ed577" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.224262] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.224416] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.229991] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.230105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.231523] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 531bc278-c746-4ada-9fc4-704b99519eae: rpc.has_security_group_logging(os_id): False [ 1069.305789] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.305929] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.311477] env[69559]: INFO networking_nsxv3.common.synchronization [req-44c747a3-84c2-4c3e-a405-02ee834a79a1 req-55b1525b-6f47-4f97-8309-032306314704 tempest-AttachVolumeTestJSON-949454441 tempest-AttachVolumeTestJSON-949454441-project-member] Enqueued Resource ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 with Priority: HIGHEST for action security_group_members [ 1069.312047] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 with Priority: HIGHEST for action security_group_members [ 1069.312323] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-18ff4996-ee34-4aa9-8c27-09de3d4a6f74 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.312444] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.312514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.312766] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.313052] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.313052] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.313159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.313231] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.313305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.313394] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18ff4996-ee34-4aa9-8c27-09de3d4a6f74',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.346362] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.346611] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.346728] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.346791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.347018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.347080] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.347326] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.347434] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.347496] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.347646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.347779] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.347976] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.348066] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.348129] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.348265] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.348344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.348420] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1069.349421] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.349584] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.349666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.349781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7f662d8-9904-44e6-8a35-051e2c4e15cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.349932] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.350092] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.350169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.350299] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-acb5a9fe-3650-403a-90f4-19ec52b5f97e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.350480] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.350682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.350768] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.350871] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1375255-0519-4538-bc3f-1cd9a0e0744c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.350982] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.351136] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.351210] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.351319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c0b6c4f-ae6a-4f68-8883-90c34a375fc7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.352127] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.352127] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.352127] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.352308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38ad73d3-d173-4ff2-9e1d-72777311ba4d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.352391] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.352486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.352559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.352674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1feb63ae-217d-4dd9-89fc-3bc266674292" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.352801] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.352951] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.353047] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.353138] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-162b0750-9392-4d6d-b97a-5ce01d5e0894" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.353247] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.353382] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.379192] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.379312] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.417320] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.417442] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.453211] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.453574] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.453682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.454319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.454319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.454319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.454319] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 531bc278-c746-4ada-9fc4-704b99519eae is going to be updated. [ 1069.455267] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.455432] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.455543] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.455627] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-858bd0a1-9ee5-49c8-ac77-f218758ad913" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.590079] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.590182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.590245] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.590490] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.590559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.590699] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f12ab78c-28a7-4f2b-a14e-b0a92a64233f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.593948] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.594189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.594189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.594335] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.594419] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.594531] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-392028d0-93e9-4420-8ca7-d3fa218b5c83" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.613840] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.613974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.614056] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.614246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.614388] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.621479] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-837 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.621668] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-837" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.621832] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-837" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.622238] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-837" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.622502] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.622664] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.622791] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.623847] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.623847] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.623847] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1069.623847] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1069.623847] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1069.623847] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1069.623847] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1069.624559] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1069.624559] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1069.625396] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.625499] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.625564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.625897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.658906] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.659088] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.688907] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1069.689139] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.065 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1069.689287] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1069.689466] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-837" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.689787] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-9b268f51-17d9-4dc3-b089-a6da9a5a7d73 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.689964] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-9b268f51-17d9-4dc3-b089-a6da9a5a7d73" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.690101] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-9b268f51-17d9-4dc3-b089-a6da9a5a7d73" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.690425] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-9b268f51-17d9-4dc3-b089-a6da9a5a7d73" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.690567] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b268f51-17d9-4dc3-b089-a6da9a5a7d73',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.691612] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1069.709600] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.709855] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.710663] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.710663] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.710663] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.710663] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.710663] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fa80a9f-7415-4f67-b83a-473ff443eaff is going to be updated. [ 1069.711876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.711958] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.712110] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.730709] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 531bc278-c746-4ada-9fc4-704b99519eae in Status: IN_PROGRESS for 2s [ 1069.788533] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.790560] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.790560] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.790560] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.790560] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.805049] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fa80a9f-7415-4f67-b83a-473ff443eaff in Status: IN_PROGRESS for 2s [ 1069.815484] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.815622] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.815685] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.816074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.816143] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.816355] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.816457] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.816520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.816702] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.816782] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.816907] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 already deleted. [ 1069.816974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.819247] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: SUCCESS [ 1069.819520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.819657] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.819880] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.820102] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.820237] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.820423] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.820534] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.820669] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.820846] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.820922] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.193433] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.193838] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.194007] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.194304] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.194463] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.194628] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 9b268f51-17d9-4dc3-b089-a6da9a5a7d73 not found, creating... [ 1070.194970] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.195156] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.195281] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.195853] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.195853] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.196112] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.196112] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.196220] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.196645] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.196645] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.196789] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 9b268f51-17d9-4dc3-b089-a6da9a5a7d73 is going to be created. [ 1070.239025] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.239262] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.239397] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.239699] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.241294] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.241545] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-9b268f51-17d9-4dc3-b089-a6da9a5a7d73" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.323813] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.323991] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.324079] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.324306] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.324477] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.324576] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.324638] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.324786] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.324903] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.324967] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.325151] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.325237] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.325373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.325424] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.325523] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.325612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.325669] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.325803] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.325875] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.325951] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.326048] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.347087] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92121496-4d0a-4f2f-b08f-e4603b279788 in Status: SUCCESS [ 1070.347303] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.347450] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.347635] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.347804] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.347913] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.347975] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.348126] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.348202] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.348285] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.348371] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92121496-4d0a-4f2f-b08f-e4603b279788',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.413680] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 in Status: SUCCESS [ 1070.413861] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 deletion is rescheduled due to dependency. [ 1070.413971] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.829643] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19282542-923d-4b29-8ce7-e30953449122: rpc.has_security_group_logging(os_id): False [ 1070.848689] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.849111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.849292] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.849601] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.854124] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-92121496-4d0a-4f2f-b08f-e4603b279788 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.854124] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.854124] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.854124] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.854124] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.854124] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.854124] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.854830] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.855042] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.855213] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.855716] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-92121496-4d0a-4f2f-b08f-e4603b279788 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.858730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.858730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.858730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.858730] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.858730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.858730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.858730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.858730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.858730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.858730] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92121496-4d0a-4f2f-b08f-e4603b279788',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.877671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.877671] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.877671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.877671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.877671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.877671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.877671] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.877671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.877671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.877671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.877671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.877671] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.877671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.877671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.878298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.878298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.878298] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19282542-923d-4b29-8ce7-e30953449122 is going to be updated. [ 1070.937612] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.937612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.937612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.937612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.937612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.948084] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: IN_PROGRESS for 2s [ 1071.041526] env[69559]: INFO networking_nsxv3.common.synchronization [req-44c747a3-84c2-4c3e-a405-02ee834a79a1 req-111693cc-d489-452c-a92d-1bf60d39b189 service nova] Enqueued Resource ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 with Priority: HIGHEST for action security_group_rules [ 1071.041722] env[69559]: INFO networking_nsxv3.common.synchronization [req-44c747a3-84c2-4c3e-a405-02ee834a79a1 req-111693cc-d489-452c-a92d-1bf60d39b189 service nova] Enqueued Resource ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 with Priority: HIGHEST for action security_group_members [ 1071.041868] env[69559]: INFO networking_nsxv3.common.synchronization [req-44c747a3-84c2-4c3e-a405-02ee834a79a1 req-111693cc-d489-452c-a92d-1bf60d39b189 service nova] Enqueued Resource ID: 9b268f51-17d9-4dc3-b089-a6da9a5a7d73 with Priority: HIGHEST for action port [ 1071.042430] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 with Priority: HIGHEST for action security_group_rules [ 1071.042571] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 with Priority: HIGHEST for action security_group_members [ 1071.042706] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b268f51-17d9-4dc3-b089-a6da9a5a7d73 with Priority: HIGHEST for action port [ 1071.042999] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18ff4996-ee34-4aa9-8c27-09de3d4a6f74 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.043300] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.043405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.043674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.043791] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18ff4996-ee34-4aa9-8c27-09de3d4a6f74',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.044714] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-18ff4996-ee34-4aa9-8c27-09de3d4a6f74 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.044925] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.045035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.045228] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.045420] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.045543] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.045638] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.045845] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.045972] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.046102] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18ff4996-ee34-4aa9-8c27-09de3d4a6f74',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.047045] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b268f51-17d9-4dc3-b089-a6da9a5a7d73 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.047132] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b268f51-17d9-4dc3-b089-a6da9a5a7d73" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.047219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b268f51-17d9-4dc3-b089-a6da9a5a7d73" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.047419] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b268f51-17d9-4dc3-b089-a6da9a5a7d73" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.047519] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b268f51-17d9-4dc3-b089-a6da9a5a7d73',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.361143] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92121496-4d0a-4f2f-b08f-e4603b279788: rpc.has_security_group_logging(os_id): False [ 1071.378027] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.378178] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.378239] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.378450] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.378540] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.378732] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.378829] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.378892] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.379051] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.379130] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.379318] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.379410] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.379472] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.379605] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.379676] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.379924] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.380045] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.380105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.380246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.380321] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.380403] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92121496-4d0a-4f2f-b08f-e4603b279788 is going to be created. [ 1071.453055] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.453246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.453246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.453453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.453640] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.466327] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92121496-4d0a-4f2f-b08f-e4603b279788 in Status: IN_PROGRESS for 2s [ 1071.550867] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-18ff4996-ee34-4aa9-8c27-09de3d4a6f74 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.550867] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.550867] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18ff4996-ee34-4aa9-8c27-09de3d4a6f74',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.550867] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b268f51-17d9-4dc3-b089-a6da9a5a7d73 with status ACTIVE [ 1071.550867] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.550867] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.550867] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.551403] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.551403] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.551403] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.551403] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.551403] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.551571] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.551571] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.551799] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.552015] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.552015] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.552115] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.552187] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.552271] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b268f51-17d9-4dc3-b089-a6da9a5a7d73 is going to be updated. [ 1071.586523] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.586725] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.586725] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.586939] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.587084] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.587246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b268f51-17d9-4dc3-b089-a6da9a5a7d73" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.675150] env[69559]: INFO networking_nsxv3.common.synchronization [req-4f6bb7ec-fe49-4cdb-943d-0a2bb7e50fbe req-177f6f96-07d9-4a05-83cf-938c768abda8 tempest-AttachVolumeNegativeTest-1400300488 tempest-AttachVolumeNegativeTest-1400300488-project-member] Enqueued Resource ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 with Priority: HIGHEST for action security_group_members [ 1071.675903] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 with Priority: HIGHEST for action security_group_members [ 1071.676350] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3283394-46a2-4c04-8d8d-61fd36d02b80 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.676529] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.676634] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.676980] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.677232] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.677388] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.677487] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.677722] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.677858] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.678009] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3283394-46a2-4c04-8d8d-61fd36d02b80',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.711687] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1071.714023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.742458] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 531bc278-c746-4ada-9fc4-704b99519eae in Status: SUCCESS [ 1071.742458] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.814834] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fa80a9f-7415-4f67-b83a-473ff443eaff in Status: SUCCESS [ 1071.815074] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fa80a9f-7415-4f67-b83a-473ff443eaff deletion is rescheduled due to dependency. [ 1071.815243] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fa80a9f-7415-4f67-b83a-473ff443eaff" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.054727] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18ff4996-ee34-4aa9-8c27-09de3d4a6f74',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.148414] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-979 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.148884] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-979" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.149113] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-979" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.149558] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-979" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.150126] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.150415] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.150734] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.151077] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.151256] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.151485] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1072.151629] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1072.151759] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1072.151873] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1072.151995] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1072.152139] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1072.152285] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1072.170694] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1072.170947] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1072.171178] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1072.171310] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-979" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.171648] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-b40c54ba-e71e-4788-91b8-eb0b4f8db8cf taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.171961] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-b40c54ba-e71e-4788-91b8-eb0b4f8db8cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.172232] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-b40c54ba-e71e-4788-91b8-eb0b4f8db8cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.172604] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-b40c54ba-e71e-4788-91b8-eb0b4f8db8cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.172809] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b40c54ba-e71e-4788-91b8-eb0b4f8db8cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.181996] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.181996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.181996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.181996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.181996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.181996] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.181996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.181996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.181996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.181996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.181996] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 already deleted. [ 1072.181996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.557932] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.558189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.558235] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.558491] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.558623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.558774] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 is going to be created. [ 1072.581670] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.581892] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.581993] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.582249] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.582435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.592325] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 in Status: UNINITIALIZED for 2s [ 1072.674900] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.675134] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.675221] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.675604] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.675789] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.675950] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port b40c54ba-e71e-4788-91b8-eb0b4f8db8cf not found, creating... [ 1072.676241] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.676410] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.676534] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.676761] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.676907] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.677222] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.677388] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.677513] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.677729] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.677872] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.678034] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: b40c54ba-e71e-4788-91b8-eb0b4f8db8cf is going to be created. [ 1072.707187] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.707487] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.707686] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.708022] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.708321] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.708682] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-b40c54ba-e71e-4788-91b8-eb0b4f8db8cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.967132] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: SUCCESS [ 1072.967511] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.967796] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.968175] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.968280] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.471577] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.471936] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.471936] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.472103] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.472209] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.472296] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.472363] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.472505] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.472591] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.472677] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.472763] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.477891] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92121496-4d0a-4f2f-b08f-e4603b279788 in Status: SUCCESS [ 1073.478125] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.489025] env[69559]: INFO networking_nsxv3.common.synchronization [req-4f6bb7ec-fe49-4cdb-943d-0a2bb7e50fbe req-4e57e1cc-1bdd-4365-8080-f87f0ffb3c65 service nova] Enqueued Resource ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 with Priority: HIGHEST for action security_group_rules [ 1073.489226] env[69559]: INFO networking_nsxv3.common.synchronization [req-4f6bb7ec-fe49-4cdb-943d-0a2bb7e50fbe req-4e57e1cc-1bdd-4365-8080-f87f0ffb3c65 service nova] Enqueued Resource ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 with Priority: HIGHEST for action security_group_members [ 1073.489372] env[69559]: INFO networking_nsxv3.common.synchronization [req-4f6bb7ec-fe49-4cdb-943d-0a2bb7e50fbe req-4e57e1cc-1bdd-4365-8080-f87f0ffb3c65 service nova] Enqueued Resource ID: b40c54ba-e71e-4788-91b8-eb0b4f8db8cf with Priority: HIGHEST for action port [ 1073.489865] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 with Priority: HIGHEST for action security_group_rules [ 1073.489999] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 with Priority: HIGHEST for action security_group_members [ 1073.491712] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b40c54ba-e71e-4788-91b8-eb0b4f8db8cf with Priority: HIGHEST for action port [ 1073.492317] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3283394-46a2-4c04-8d8d-61fd36d02b80 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.492411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.492469] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.492662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.492743] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3283394-46a2-4c04-8d8d-61fd36d02b80',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.494174] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3283394-46a2-4c04-8d8d-61fd36d02b80 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.494270] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.494341] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.494509] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.495145] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.495236] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.495285] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.495429] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.495518] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.495608] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3283394-46a2-4c04-8d8d-61fd36d02b80',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.496912] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-b40c54ba-e71e-4788-91b8-eb0b4f8db8cf taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.499643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b40c54ba-e71e-4788-91b8-eb0b4f8db8cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.499643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b40c54ba-e71e-4788-91b8-eb0b4f8db8cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.499643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b40c54ba-e71e-4788-91b8-eb0b4f8db8cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.499643] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b40c54ba-e71e-4788-91b8-eb0b4f8db8cf',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.975347] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.975537] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.975601] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.975800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.975975] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.976087] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.976148] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.976291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.976378] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.976464] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.976679] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.976781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.976839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.976980] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.977132] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.977224] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.977278] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.977827] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.977827] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.977827] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.977827] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.000929] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3283394-46a2-4c04-8d8d-61fd36d02b80 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.001087] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.001274] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3283394-46a2-4c04-8d8d-61fd36d02b80',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.002429] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b40c54ba-e71e-4788-91b8-eb0b4f8db8cf with status ACTIVE [ 1074.002429] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.002429] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.002429] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.002627] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.002782] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.003103] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.003103] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.003103] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.003257] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.003332] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.003557] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.004594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.004594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.004594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.004594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.004594] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b40c54ba-e71e-4788-91b8-eb0b4f8db8cf is going to be updated. [ 1074.025325] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.025514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.025514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.025718] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.025849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.025999] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b40c54ba-e71e-4788-91b8-eb0b4f8db8cf" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.480377] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19282542-923d-4b29-8ce7-e30953449122: rpc.has_security_group_logging(os_id): False [ 1074.502606] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.502790] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.502875] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.503158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.503252] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.503464] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.503624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.503714] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.503959] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.504098] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.504325] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.504417] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.504511] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.504621] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.504696] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.504882] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.504978] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.505040] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.505186] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.505262] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.505377] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19282542-923d-4b29-8ce7-e30953449122 is going to be updated. [ 1074.506480] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3283394-46a2-4c04-8d8d-61fd36d02b80',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.585490] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.585490] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.585490] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.585490] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.585490] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.599656] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: IN_PROGRESS for 2s [ 1074.600509] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 in Status: SUCCESS [ 1074.600735] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.600895] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.601171] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.601371] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.601491] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.601558] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.601741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.601825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.601914] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.602015] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18ff4996-ee34-4aa9-8c27-09de3d4a6f74',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.954882] env[69559]: INFO networking_nsxv3.common.synchronization [req-8fd5ded7-5a54-4e59-9994-8c7c369a59e4 req-eb05bb9e-0376-4670-aa06-bb153ef41682 tempest-ImagesOneServerNegativeTestJSON-1590344667 tempest-ImagesOneServerNegativeTestJSON-1590344667-project-member] Enqueued Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_members [ 1074.955033] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_members [ 1074.955443] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.955647] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.955741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.956106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.956220] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.956362] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.956445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.956839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.956949] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.957059] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.009911] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.010225] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.010225] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.012125] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.012125] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.012125] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 is going to be created. [ 1075.036428] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.036627] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.036737] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.037053] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.037440] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.046449] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 in Status: UNINITIALIZED for 2s [ 1075.103983] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18ff4996-ee34-4aa9-8c27-09de3d4a6f74',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.343167] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-114 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.343167] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-114" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.344706] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-114" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.345790] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-114" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.345790] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.345790] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.346074] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.346129] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.346240] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.346608] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.346608] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.346732] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.347331] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.347518] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.347638] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.347814] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.372855] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.373135] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1075.373326] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.373569] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-114" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.374031] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-d9752196-a5b0-4449-a886-a11871a869c4 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.374256] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-d9752196-a5b0-4449-a886-a11871a869c4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.374511] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-d9752196-a5b0-4449-a886-a11871a869c4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.374905] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-d9752196-a5b0-4449-a886-a11871a869c4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.375079] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9752196-a5b0-4449-a886-a11871a869c4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.459465] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.459465] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.459847] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.460043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.460227] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.460523] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.460758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.460875] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.461102] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.461386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.461386] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b4e023e-3f17-4641-b235-16fa1645d85a is going to be deleted. [ 1075.491206] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.491662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.491662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.491797] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.491974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.492118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.605814] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18ff4996-ee34-4aa9-8c27-09de3d4a6f74: rpc.has_security_group_logging(os_id): False [ 1075.623509] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.623663] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.623732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.623946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.624218] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.624324] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.624450] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.624508] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.625613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.625613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.625613] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 is going to be created. [ 1075.685258] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.685390] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.685458] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.685664] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.685877] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.702080] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 in Status: IN_PROGRESS for 2s [ 1075.878038] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.878292] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.878428] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.878777] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.878950] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.879135] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port d9752196-a5b0-4449-a886-a11871a869c4 not found, creating... [ 1075.879410] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.879577] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.879702] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.879929] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.880085] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.880375] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.880538] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.880698] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.880910] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.881068] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.881219] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: d9752196-a5b0-4449-a886-a11871a869c4 is going to be created. [ 1075.906683] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.906901] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.907044] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.907316] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.907549] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.907775] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-d9752196-a5b0-4449-a886-a11871a869c4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.615912] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: SUCCESS [ 1076.616710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.656722] env[69559]: INFO networking_nsxv3.common.synchronization [req-8fd5ded7-5a54-4e59-9994-8c7c369a59e4 req-ec1cab8b-cb33-4bb1-a599-6c15c91373ec service nova] Enqueued Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_rules [ 1076.656946] env[69559]: INFO networking_nsxv3.common.synchronization [req-8fd5ded7-5a54-4e59-9994-8c7c369a59e4 req-ec1cab8b-cb33-4bb1-a599-6c15c91373ec service nova] Enqueued Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_members [ 1076.657133] env[69559]: INFO networking_nsxv3.common.synchronization [req-8fd5ded7-5a54-4e59-9994-8c7c369a59e4 req-ec1cab8b-cb33-4bb1-a599-6c15c91373ec service nova] Enqueued Resource ID: d9752196-a5b0-4449-a886-a11871a869c4 with Priority: HIGHEST for action port [ 1076.657719] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_rules [ 1076.657820] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_members [ 1076.657931] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9752196-a5b0-4449-a886-a11871a869c4 with Priority: HIGHEST for action port [ 1076.659298] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.659500] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.660806] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.661073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.661220] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.662241] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.662365] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.662477] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.662806] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.663035] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.663184] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.663272] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.663468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.663589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.663785] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.664729] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9752196-a5b0-4449-a886-a11871a869c4 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.664846] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9752196-a5b0-4449-a886-a11871a869c4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.664913] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9752196-a5b0-4449-a886-a11871a869c4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.665118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9752196-a5b0-4449-a886-a11871a869c4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.665235] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9752196-a5b0-4449-a886-a11871a869c4',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.057066] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 in Status: SUCCESS [ 1077.057066] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.057066] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.057066] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.057066] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.057066] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.057066] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.057066] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.057066] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.057066] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.057604] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3283394-46a2-4c04-8d8d-61fd36d02b80',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.168144] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9752196-a5b0-4449-a886-a11871a869c4 with status ACTIVE [ 1077.168422] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.168631] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.168706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.169055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.169188] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.169429] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.169539] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.169604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.169770] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.169850] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.170093] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.170224] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.170332] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.170450] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.170550] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.170698] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9752196-a5b0-4449-a886-a11871a869c4 is going to be updated. [ 1077.171948] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.172097] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.172329] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.200088] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.200088] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.200088] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.200088] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.200520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.200575] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9752196-a5b0-4449-a886-a11871a869c4" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.560308] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3283394-46a2-4c04-8d8d-61fd36d02b80',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.674934] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.715035] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 in Status: SUCCESS [ 1077.715274] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.047705] env[69559]: INFO networking_nsxv3.common.synchronization [req-ea7304a7-8a9b-4b32-8b3c-1292b9d8a59f req-67ec89be-f4fd-46c3-9844-f6c7c8cb0d0b tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 1078.047705] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 1078.047705] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.047705] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.047705] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.048180] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.048474] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.048821] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.049021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.049283] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.049488] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.049684] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.063111] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3283394-46a2-4c04-8d8d-61fd36d02b80: rpc.has_security_group_logging(os_id): False [ 1078.090575] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.090799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.090848] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.091069] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.091162] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.091410] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.091521] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.091587] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.091738] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.091815] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.091923] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 is going to be created. [ 1078.177315] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.177531] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.177579] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.177769] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.177882] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.177987] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b4e023e-3f17-4641-b235-16fa1645d85a is going to be created. [ 1078.217819] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.218032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.218173] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.218309] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.218491] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.236956] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 in Status: IN_PROGRESS for 2s [ 1078.248535] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.248733] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.248826] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.249054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.249217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.278070] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b4e023e-3f17-4641-b235-16fa1645d85a in Status: UNINITIALIZED for 2s [ 1078.489599] env[69559]: INFO networking_nsxv3.common.synchronization [None req-202f6cc5-52b4-4433-8d48-2a4803281944 tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 1078.490023] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 1078.491688] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.491688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.552243] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.844873] env[69559]: INFO networking_nsxv3.common.synchronization [req-3b716436-ac40-4c55-8a31-af68a2bd1009 req-db3f4470-6e71-41f5-8dc5-fd6bd95dda8d tempest-ServerTagsTestJSON-1422397021 tempest-ServerTagsTestJSON-1422397021-project-member] Enqueued Resource ID: 92121496-4d0a-4f2f-b08f-e4603b279788 with Priority: HIGHEST for action security_group_members [ 1078.845905] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92121496-4d0a-4f2f-b08f-e4603b279788 with Priority: HIGHEST for action security_group_members [ 1078.845905] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-92121496-4d0a-4f2f-b08f-e4603b279788 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.845905] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.846323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.846323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.846397] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.846453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.846494] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.846623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.846793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.846793] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92121496-4d0a-4f2f-b08f-e4603b279788',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.055674] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.351620] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.351620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.351620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.351620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.351620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.351620] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.351620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.351620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.351620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.351620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.351620] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92121496-4d0a-4f2f-b08f-e4603b279788 is going to be updated. [ 1079.377614] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.377811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.377811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.378039] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.378161] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.386672] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92121496-4d0a-4f2f-b08f-e4603b279788 in Status: IN_PROGRESS for 2s [ 1079.555569] env[69559]: INFO networking_nsxv3.common.synchronization [req-f7f6ae55-3a9c-4fbf-8bad-5e712e29a8b7 req-70636ed1-c46f-4e71-931e-ad9dc15769c1 tempest-ServerRescueNegativeTestJSON-1113411482 tempest-ServerRescueNegativeTestJSON-1113411482-project-member] Enqueued Resource ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b with Priority: HIGHEST for action security_group_members [ 1079.556136] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b with Priority: HIGHEST for action security_group_members [ 1079.556572] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.556717] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.556717] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.556872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.557764] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.557928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.558090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.559974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.560139] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.560251] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a11f9ece-2d6a-48aa-bfa9-8e391de87f3b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.562023] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.562161] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.562217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.562385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.562477] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.562571] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19282542-923d-4b29-8ce7-e30953449122 is going to be updated. [ 1079.597929] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.598615] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.598615] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.598615] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.598615] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.606932] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: IN_PROGRESS for 2s [ 1080.066709] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.069179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.069179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.069179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.095788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.096445] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.097367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.097367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.097367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.097367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.097367] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b is going to be updated. [ 1080.140955] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.141133] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.141204] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.141411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.141551] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.152100] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b in Status: IN_PROGRESS for 2s [ 1080.249750] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 in Status: SUCCESS [ 1080.249979] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.287862] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b4e023e-3f17-4641-b235-16fa1645d85a in Status: SUCCESS [ 1080.287862] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.288105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.289028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.289028] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.289028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.289028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.289028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.289028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.289028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.289028] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.791940] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.792123] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.792394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.792436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.794023] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.794023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.794023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.794023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.794023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.794023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.794023] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.794023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.794023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.794023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.794023] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.794023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.794582] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.794582] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.794582] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.794582] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.794582] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.122947] env[69559]: INFO networking_nsxv3.common.synchronization [req-df117572-014d-4378-99d1-2d8e84a89333 req-4d796298-da33-4b71-bc06-31d3b4e8bdf8 tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 868ef973-ca6a-480b-be75-839232b752db with Priority: HIGHEST for action security_group_members [ 1081.123453] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 868ef973-ca6a-480b-be75-839232b752db with Priority: HIGHEST for action security_group_members [ 1081.124379] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-868ef973-ca6a-480b-be75-839232b752db taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.124379] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.124379] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.124379] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.124592] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.124592] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.124592] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.124704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.124759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.124854] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('868ef973-ca6a-480b-be75-839232b752db',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.210615] env[69559]: INFO networking_nsxv3.common.synchronization [req-b7a33079-d609-41f3-b277-55b4e4a7f893 req-77395b81-8866-4dba-ad9f-686370f0adab tempest-ServersTestJSON-514909010 tempest-ServersTestJSON-514909010-project-member] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1081.211461] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1081.211793] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.211967] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.214422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.214650] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.216681] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.216681] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.216681] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.216681] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.216681] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.216681] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.298276] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b4e023e-3f17-4641-b235-16fa1645d85a: rpc.has_security_group_logging(os_id): False [ 1081.315582] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.315702] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.315740] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.315944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.317412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.317412] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.317412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.317412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.317412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.317412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.317412] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.317412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.317412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.317412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.317412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.317902] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.317902] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.317902] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.317902] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.317902] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.317902] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b4e023e-3f17-4641-b235-16fa1645d85a is going to be created. [ 1081.374684] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.374684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.374684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.374684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.374684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.383439] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b4e023e-3f17-4641-b235-16fa1645d85a in Status: IN_PROGRESS for 2s [ 1081.404350] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92121496-4d0a-4f2f-b08f-e4603b279788 in Status: SUCCESS [ 1081.404545] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92121496-4d0a-4f2f-b08f-e4603b279788 deletion is rescheduled due to dependency. [ 1081.404658] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.611642] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-640 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.611947] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.612131] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.612414] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.612712] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.612883] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.613017] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.613243] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.613394] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.613608] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1081.613727] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1081.613844] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1081.613958] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1081.614085] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1081.614199] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1081.614339] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1081.615860] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: SUCCESS [ 1081.616061] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.616497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.616660] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.616812] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.616914] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.616977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.617131] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.617210] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.617298] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.626849] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.626947] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.626988] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.627179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.644372] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1081.644569] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1081.644720] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1081.644910] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.645256] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-512d25e4-09d9-49de-96da-6da550c1eb74 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.645435] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-512d25e4-09d9-49de-96da-6da550c1eb74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.645567] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-512d25e4-09d9-49de-96da-6da550c1eb74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.645856] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-512d25e4-09d9-49de-96da-6da550c1eb74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.646007] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('512d25e4-09d9-49de-96da-6da550c1eb74',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.652179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.652376] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.652481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.652548] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.652707] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.652788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.652876] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 868ef973-ca6a-480b-be75-839232b752db is going to be updated. [ 1081.677656] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.677792] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.677836] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.677995] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.678225] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.685331] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 868ef973-ca6a-480b-be75-839232b752db in Status: IN_PROGRESS for 2s [ 1081.718708] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.119397] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.119900] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.119900] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.119900] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.120912] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.120912] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.120912] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.120912] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.120912] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.120912] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.120912] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19282542-923d-4b29-8ce7-e30953449122 is going to be updated. [ 1082.146419] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.146701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.146701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.146839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.147076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.149152] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.149152] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.149152] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.149523] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.149704] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.149893] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 512d25e4-09d9-49de-96da-6da550c1eb74 not found, creating... [ 1082.150201] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.150373] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.150498] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.150752] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.150919] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.151231] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.151398] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.151521] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.151745] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.151893] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.152049] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 512d25e4-09d9-49de-96da-6da550c1eb74 is going to be created. [ 1082.175017] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b in Status: SUCCESS [ 1082.175265] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b deletion is rescheduled due to dependency. [ 1082.175318] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.176145] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: IN_PROGRESS for 2s [ 1082.194512] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.194745] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.194879] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.195321] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.195621] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.195805] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-512d25e4-09d9-49de-96da-6da550c1eb74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.220615] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.724083] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.724083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.724083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.724083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.724083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.724283] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1082.752720] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.752860] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.752933] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.753167] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.753314] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.763373] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1082.881118] env[69559]: INFO networking_nsxv3.common.synchronization [req-b7a33079-d609-41f3-b277-55b4e4a7f893 req-f670954a-27a9-476c-b599-eaaf6c60cb22 service nova] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_rules [ 1082.881349] env[69559]: INFO networking_nsxv3.common.synchronization [req-b7a33079-d609-41f3-b277-55b4e4a7f893 req-f670954a-27a9-476c-b599-eaaf6c60cb22 service nova] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1082.881497] env[69559]: INFO networking_nsxv3.common.synchronization [req-b7a33079-d609-41f3-b277-55b4e4a7f893 req-f670954a-27a9-476c-b599-eaaf6c60cb22 service nova] Enqueued Resource ID: 512d25e4-09d9-49de-96da-6da550c1eb74 with Priority: HIGHEST for action port [ 1082.882021] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_rules [ 1082.883648] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1082.883760] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 512d25e4-09d9-49de-96da-6da550c1eb74 with Priority: HIGHEST for action port [ 1082.884070] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.884202] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.884269] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.884472] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.884554] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.885417] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.885541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.885768] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-512d25e4-09d9-49de-96da-6da550c1eb74 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.885875] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-512d25e4-09d9-49de-96da-6da550c1eb74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.885939] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-512d25e4-09d9-49de-96da-6da550c1eb74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.886117] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-512d25e4-09d9-49de-96da-6da550c1eb74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.886195] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('512d25e4-09d9-49de-96da-6da550c1eb74',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.388672] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.388672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.396373] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 512d25e4-09d9-49de-96da-6da550c1eb74 with status ACTIVE [ 1083.396373] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.396492] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.396543] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.396713] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.396807] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.397018] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.397158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.397224] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.397380] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.397461] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.397694] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.397807] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.397865] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.398151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.398151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.398151] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 512d25e4-09d9-49de-96da-6da550c1eb74 is going to be updated. [ 1083.401482] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b4e023e-3f17-4641-b235-16fa1645d85a in Status: SUCCESS [ 1083.401568] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.422601] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.422793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.422947] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.423092] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.423289] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.423518] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-512d25e4-09d9-49de-96da-6da550c1eb74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.695773] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 868ef973-ca6a-480b-be75-839232b752db in Status: SUCCESS [ 1083.695773] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 868ef973-ca6a-480b-be75-839232b752db deletion is rescheduled due to dependency. [ 1083.695773] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.188717] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: SUCCESS [ 1084.189012] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19282542-923d-4b29-8ce7-e30953449122 deletion is rescheduled due to dependency. [ 1084.189085] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.773854] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1084.774142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.774281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.774551] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.774738] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.774858] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.774926] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.775090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.775170] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.775263] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.281037] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.782372] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.286605] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.286808] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.286920] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.287244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.287244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.287389] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1086.316552] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.316825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.316825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.317021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.317178] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.326991] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1086.384770] env[69559]: INFO networking_nsxv3.common.synchronization [None req-a47eda4a-5b32-47a0-ab8c-c42ebd3dc970 None None] Enqueued Resource ID: a5cd697d-1405-4b07-b575-73c6c3dcf8da with Priority: HIGHEST for action port [ 1086.385404] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5cd697d-1405-4b07-b575-73c6c3dcf8da with Priority: HIGHEST for action port [ 1086.386322] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5cd697d-1405-4b07-b575-73c6c3dcf8da taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.386461] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5cd697d-1405-4b07-b575-73c6c3dcf8da" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.386514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5cd697d-1405-4b07-b575-73c6c3dcf8da" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.386770] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5cd697d-1405-4b07-b575-73c6c3dcf8da" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.386853] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5cd697d-1405-4b07-b575-73c6c3dcf8da',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.888553] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5cd697d-1405-4b07-b575-73c6c3dcf8da [ 1086.888896] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.890031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.890128] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.890410] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.890847] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.890847] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5cd697d-1405-4b07-b575-73c6c3dcf8da already deleted. [ 1086.890847] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5cd697d-1405-4b07-b575-73c6c3dcf8da" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.076655] env[69559]: INFO networking_nsxv3.common.synchronization [None req-ff999004-ea31-421c-82d7-858154e1d70c tempest-AttachVolumeShelveTestJSON-1912655505 tempest-AttachVolumeShelveTestJSON-1912655505-project-member] Enqueued Resource ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 with Priority: HIGHEST for action security_group_rules [ 1087.080086] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 with Priority: HIGHEST for action security_group_rules [ 1087.080439] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c048f2fc-8707-43d6-b2f1-033edda0ea00 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.080572] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.080639] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.080977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.081069] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c048f2fc-8707-43d6-b2f1-033edda0ea00',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.180213] env[69559]: INFO networking_nsxv3.common.synchronization [None req-c07feab2-76b8-4153-8058-8ffa9022933b tempest-AttachVolumeShelveTestJSON-1912655505 tempest-AttachVolumeShelveTestJSON-1912655505-project-member] Enqueued Resource ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 with Priority: HIGHEST for action security_group_rules [ 1087.180734] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 with Priority: HIGHEST for action security_group_rules [ 1087.181069] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c048f2fc-8707-43d6-b2f1-033edda0ea00 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.181171] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.614276] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.614665] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.614797] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.615039] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.615139] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.615242] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 already deleted. [ 1087.615329] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.615526] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.615752] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.616254] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c048f2fc-8707-43d6-b2f1-033edda0ea00',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.139432] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.139432] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.139432] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.139432] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.139432] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.139432] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 already deleted. [ 1088.139432] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.337985] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1088.338217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.338382] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.338595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.339414] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.339414] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.339414] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.339414] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.339414] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.339414] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.341503] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.647720] env[69559]: INFO networking_nsxv3.common.synchronization [None req-e6db68e8-28ed-40d0-bc12-55ea77e1e7f1 None None] Enqueued Resource ID: 051a84aa-f86e-47a9-aaf4-e929af94cf43 with Priority: HIGHEST for action port [ 1088.649513] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 051a84aa-f86e-47a9-aaf4-e929af94cf43 with Priority: HIGHEST for action port [ 1088.649513] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-051a84aa-f86e-47a9-aaf4-e929af94cf43 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.649513] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-051a84aa-f86e-47a9-aaf4-e929af94cf43" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.649513] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-051a84aa-f86e-47a9-aaf4-e929af94cf43" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.649513] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-051a84aa-f86e-47a9-aaf4-e929af94cf43" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.649513] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('051a84aa-f86e-47a9-aaf4-e929af94cf43',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.843095] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.847027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.847027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.847027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.847027] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.847027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.847027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.847027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.847027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.847027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.847027] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.847027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.847027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.847027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.847027] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.847027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.847954] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.847954] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.847954] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.847954] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.847954] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.874602] env[69559]: INFO networking_nsxv3.common.synchronization [req-6b6880c0-dcef-4099-868d-910a107305f7 req-30dc8b69-50f3-41e2-b30c-cea9d64787e1 tempest-ServerActionsTestOtherB-703157979 tempest-ServerActionsTestOtherB-703157979-project-member] Enqueued Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_members [ 1088.875147] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_members [ 1088.875469] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-64914acb-965b-4269-aaa5-676103c45a62 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.875698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.875698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.875866] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.876165] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.876330] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.876464] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.876546] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.876656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.876772] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.152418] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 051a84aa-f86e-47a9-aaf4-e929af94cf43 [ 1089.152835] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.153045] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.153120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.153334] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.153431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.153525] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:051a84aa-f86e-47a9-aaf4-e929af94cf43 already deleted. [ 1089.153613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-051a84aa-f86e-47a9-aaf4-e929af94cf43" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.221582] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-289 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.221856] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-289" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.221976] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-289" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.222300] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-289" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.222590] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.223197] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.223372] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.223768] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.223951] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.224230] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1089.224395] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.224544] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.224943] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.225242] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1089.225398] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.225578] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.262109] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.262322] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1089.262477] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.262727] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-289" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.263027] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-59c163b3-8a30-4f5e-b748-a0d76793404e taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.263222] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-59c163b3-8a30-4f5e-b748-a0d76793404e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.263622] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-59c163b3-8a30-4f5e-b748-a0d76793404e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.263707] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-59c163b3-8a30-4f5e-b748-a0d76793404e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.263833] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59c163b3-8a30-4f5e-b748-a0d76793404e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.276977] env[69559]: INFO networking_nsxv3.common.synchronization [None req-c84d1d9a-2af4-4183-8741-d801cb3033ab None None] Enqueued Resource ID: 374f36ca-c7c7-4d60-994b-281ddfdeace7 with Priority: HIGHEST for action port [ 1089.276977] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 374f36ca-c7c7-4d60-994b-281ddfdeace7 with Priority: HIGHEST for action port [ 1089.276977] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-374f36ca-c7c7-4d60-994b-281ddfdeace7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.277338] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-374f36ca-c7c7-4d60-994b-281ddfdeace7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.277573] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-374f36ca-c7c7-4d60-994b-281ddfdeace7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.277724] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-374f36ca-c7c7-4d60-994b-281ddfdeace7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.277724] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('374f36ca-c7c7-4d60-994b-281ddfdeace7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.353486] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebf5f404-8f48-487f-b212-72786dc389e8: rpc.has_security_group_logging(os_id): False [ 1089.379753] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.379900] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.380083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.380199] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.383497] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.383497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.404085] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.404343] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.404466] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.404522] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.404717] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.404871] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.404934] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64914acb-965b-4269-aaa5-676103c45a62 is going to be updated. [ 1089.405957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.406242] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.406242] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.406420] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.406530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.406593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.406739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.406816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.407021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.407121] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.407174] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.407325] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.407377] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.407621] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.407755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.407817] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.407961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.408042] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.408131] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1089.446217] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.446426] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.446426] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.446664] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.446787] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.459164] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: IN_PROGRESS for 2s [ 1089.476270] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.476811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.477067] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.477480] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.478019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.496315] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1089.767792] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.767963] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.768124] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.768425] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.768577] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.768809] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 59c163b3-8a30-4f5e-b748-a0d76793404e not found, creating... [ 1089.769178] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.770262] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.770262] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.770262] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.770262] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.770262] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.770999] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.771166] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.771452] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.771642] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.771863] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 59c163b3-8a30-4f5e-b748-a0d76793404e is going to be created. [ 1089.780805] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 374f36ca-c7c7-4d60-994b-281ddfdeace7 [ 1089.780980] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.781092] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.781166] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.781474] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.782489] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.782489] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:374f36ca-c7c7-4d60-994b-281ddfdeace7 already deleted. [ 1089.782489] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-374f36ca-c7c7-4d60-994b-281ddfdeace7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.793803] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.793963] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.795032] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.795032] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.795032] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.795032] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-59c163b3-8a30-4f5e-b748-a0d76793404e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.479099] env[69559]: INFO networking_nsxv3.common.synchronization [req-6b6880c0-dcef-4099-868d-910a107305f7 req-591f05d4-8c4c-482f-b59c-b275f253bb68 service nova] Enqueued Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_rules [ 1090.479099] env[69559]: INFO networking_nsxv3.common.synchronization [req-6b6880c0-dcef-4099-868d-910a107305f7 req-591f05d4-8c4c-482f-b59c-b275f253bb68 service nova] Enqueued Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_members [ 1090.479099] env[69559]: INFO networking_nsxv3.common.synchronization [req-6b6880c0-dcef-4099-868d-910a107305f7 req-591f05d4-8c4c-482f-b59c-b275f253bb68 service nova] Enqueued Resource ID: 59c163b3-8a30-4f5e-b748-a0d76793404e with Priority: HIGHEST for action port [ 1090.479483] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_rules [ 1090.479483] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_members [ 1090.479483] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c163b3-8a30-4f5e-b748-a0d76793404e with Priority: HIGHEST for action port [ 1090.480392] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64914acb-965b-4269-aaa5-676103c45a62 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.480572] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.480639] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.481015] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.481015] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.481772] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-64914acb-965b-4269-aaa5-676103c45a62 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.481859] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.482056] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-59c163b3-8a30-4f5e-b748-a0d76793404e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.482173] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59c163b3-8a30-4f5e-b748-a0d76793404e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.482239] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59c163b3-8a30-4f5e-b748-a0d76793404e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.482422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59c163b3-8a30-4f5e-b748-a0d76793404e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.482494] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59c163b3-8a30-4f5e-b748-a0d76793404e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.988487] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-64914acb-965b-4269-aaa5-676103c45a62 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.988487] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.988487] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 59c163b3-8a30-4f5e-b748-a0d76793404e with status ACTIVE [ 1090.988487] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.988487] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.988487] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.989090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.989090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.989090] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.989524] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.989524] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.989524] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.989672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.989907] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.990037] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.990102] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.990254] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.990416] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.990470] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 59c163b3-8a30-4f5e-b748-a0d76793404e is going to be updated. [ 1091.014833] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.015045] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.015142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.015591] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.015876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.016225] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59c163b3-8a30-4f5e-b748-a0d76793404e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.469797] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: SUCCESS [ 1091.469983] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64914acb-965b-4269-aaa5-676103c45a62 deletion is rescheduled due to dependency. [ 1091.470118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.470286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.470510] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.470724] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.470899] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.470981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.471172] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.471256] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.471353] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.479709] env[69559]: INFO networking_nsxv3.common.synchronization [None req-15c5dc55-1d2f-406c-ba3b-aa8ebad8b060 None None] Enqueued Resource ID: 08a91288-8959-4fd8-8672-6532220146fe with Priority: HIGHEST for action port [ 1091.480258] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08a91288-8959-4fd8-8672-6532220146fe with Priority: HIGHEST for action port [ 1091.480580] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-08a91288-8959-4fd8-8672-6532220146fe taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.480705] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08a91288-8959-4fd8-8672-6532220146fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.480780] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08a91288-8959-4fd8-8672-6532220146fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.482094] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08a91288-8959-4fd8-8672-6532220146fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.482158] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08a91288-8959-4fd8-8672-6532220146fe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.509121] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1091.509121] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.982026] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.985180] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08a91288-8959-4fd8-8672-6532220146fe [ 1091.985398] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.985530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.985588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.986337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.986337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.986415] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08a91288-8959-4fd8-8672-6532220146fe already deleted. [ 1091.986457] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08a91288-8959-4fd8-8672-6532220146fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.481358] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.894996] env[69559]: INFO networking_nsxv3.common.synchronization [req-12886f74-0648-4c6c-b21c-88ed779fe391 req-e4578ae8-8a9f-4887-ad68-e6f6d1b492ad tempest-DeleteServersTestJSON-1423597435 tempest-DeleteServersTestJSON-1423597435-project-member] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 1092.895608] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 1092.895953] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.896543] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.896543] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.896773] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.896947] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.897066] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.897133] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.897284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.897367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.897459] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.987030] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.987207] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.987278] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.987488] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.987581] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.987676] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64914acb-965b-4269-aaa5-676103c45a62 is going to be updated. [ 1093.023171] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.023340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.023384] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.023611] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.023733] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.034931] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: IN_PROGRESS for 2s [ 1093.320635] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-596 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.320935] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.321174] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.321509] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.321889] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.322120] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.322336] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.322602] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.322841] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.323134] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1093.323345] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1093.323464] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1093.323642] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1093.323779] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1093.323894] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1093.324090] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1093.342288] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1093.342454] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1093.342596] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1093.342785] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-596" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.343151] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-24e82a85-58ca-4b3f-bf28-e5da14404efa taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.343309] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-24e82a85-58ca-4b3f-bf28-e5da14404efa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.343436] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-24e82a85-58ca-4b3f-bf28-e5da14404efa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.343899] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-24e82a85-58ca-4b3f-bf28-e5da14404efa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.343997] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24e82a85-58ca-4b3f-bf28-e5da14404efa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.399492] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.400298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.400298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.400298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.419976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.420183] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.420366] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.420447] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.420606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.420706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.420795] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be updated. [ 1093.445299] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.445478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.445568] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.445983] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.445983] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.454739] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 1093.846610] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.847036] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.847036] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.850578] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.850578] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.850578] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 24e82a85-58ca-4b3f-bf28-e5da14404efa not found, creating... [ 1093.850578] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.850578] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.850578] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.850578] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.850578] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.850578] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.850578] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.851134] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.851134] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.851134] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.851134] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 24e82a85-58ca-4b3f-bf28-e5da14404efa is going to be created. [ 1093.868915] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.869626] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.869626] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.869626] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.869741] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.869928] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-24e82a85-58ca-4b3f-bf28-e5da14404efa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.657185] env[69559]: INFO networking_nsxv3.common.synchronization [req-12886f74-0648-4c6c-b21c-88ed779fe391 req-3902c99f-2491-42cf-a0ce-b7016b764843 service nova] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_rules [ 1094.657185] env[69559]: INFO networking_nsxv3.common.synchronization [req-12886f74-0648-4c6c-b21c-88ed779fe391 req-3902c99f-2491-42cf-a0ce-b7016b764843 service nova] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 1094.657185] env[69559]: INFO networking_nsxv3.common.synchronization [req-12886f74-0648-4c6c-b21c-88ed779fe391 req-3902c99f-2491-42cf-a0ce-b7016b764843 service nova] Enqueued Resource ID: 24e82a85-58ca-4b3f-bf28-e5da14404efa with Priority: HIGHEST for action port [ 1094.657185] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_rules [ 1094.657185] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 1094.657185] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24e82a85-58ca-4b3f-bf28-e5da14404efa with Priority: HIGHEST for action port [ 1094.658047] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.659183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.659183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.659183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.659183] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.659793] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.660053] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.660906] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-24e82a85-58ca-4b3f-bf28-e5da14404efa taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.661069] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24e82a85-58ca-4b3f-bf28-e5da14404efa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.661214] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24e82a85-58ca-4b3f-bf28-e5da14404efa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.661416] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24e82a85-58ca-4b3f-bf28-e5da14404efa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.661519] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24e82a85-58ca-4b3f-bf28-e5da14404efa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.045266] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: SUCCESS [ 1095.045725] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.045725] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.045964] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.046624] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.046624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.046624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.046624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.046825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.046825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.046879] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.163444] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.163602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.168294] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24e82a85-58ca-4b3f-bf28-e5da14404efa with status ACTIVE [ 1095.168650] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.168737] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.168737] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.172021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.172021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.172021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.172021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.172021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.172021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.172021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.172021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.172021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.172021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.172021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.172021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.172021] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24e82a85-58ca-4b3f-bf28-e5da14404efa is going to be updated. [ 1095.192285] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.192434] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.192472] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.192710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.192861] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.194169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24e82a85-58ca-4b3f-bf28-e5da14404efa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.367773] env[69559]: INFO networking_nsxv3.common.synchronization [None req-79f89cc4-803c-4c99-b6b1-7c86304478e2 tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGHEST for action security_group_rules [ 1095.368198] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGHEST for action security_group_rules [ 1095.368531] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.368926] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.370322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.370322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.370322] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.463722] env[69559]: INFO networking_nsxv3.common.synchronization [None req-760b1bc7-b83b-4612-b60b-4e9cc026f6e1 tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGHEST for action security_group_rules [ 1095.464677] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 1095.464846] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d deletion is rescheduled due to dependency. [ 1095.464958] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.465516] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGHEST for action security_group_rules [ 1095.465863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.466174] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.466450] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.466603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.466691] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.466875] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.466985] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.467129] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.468100] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.468234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.549466] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.891624] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.891855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.891855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.892225] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.892225] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.892652] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 already deleted. [ 1095.892652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.892652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.892837] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.892837] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.969583] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.051118] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64914acb-965b-4269-aaa5-676103c45a62: rpc.has_security_group_logging(os_id): False [ 1096.068196] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.068346] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.068411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.068618] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.068710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.068951] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.069064] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.069129] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.069274] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.070107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.070107] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64914acb-965b-4269-aaa5-676103c45a62 is going to be updated. [ 1096.125583] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.125729] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.125803] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.126015] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.126168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.137732] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: IN_PROGRESS for 2s [ 1096.415983] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.416246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.416416] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.416634] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.416764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.416923] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 already deleted. [ 1096.417055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.472995] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.977994] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.977994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.977994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.977994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.977994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.977994] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be updated. [ 1097.017245] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.017431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.017475] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.017675] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.017818] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.025312] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 1097.147771] env[69559]: INFO networking_nsxv3.common.synchronization [req-bb6079e1-04c3-4fb3-9856-f56b6f375db4 req-0ef75cc2-066e-4ff8-a75f-4ec2cc015bcb tempest-AttachVolumeShelveTestJSON-1912655505 tempest-AttachVolumeShelveTestJSON-1912655505-project-member] Enqueued Resource ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 with Priority: HIGHEST for action security_group_members [ 1097.148337] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 with Priority: HIGHEST for action security_group_members [ 1097.148640] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c048f2fc-8707-43d6-b2f1-033edda0ea00 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.148765] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.148836] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.149140] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.149301] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.149405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.149469] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.149622] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.149707] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.149797] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c048f2fc-8707-43d6-b2f1-033edda0ea00',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.532248] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-946 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.532557] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-946" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.532718] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-946" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.533541] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-946" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.533972] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.534271] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.534504] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.534873] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.535161] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.535514] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1097.535769] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1097.535988] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1097.536237] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1097.536471] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1097.536713] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1097.536976] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1097.556010] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1097.556297] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1097.556466] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1097.556716] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-946" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.557131] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-5dc09d14-4eb1-43e1-87d3-6f459ebe034e taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.557350] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-5dc09d14-4eb1-43e1-87d3-6f459ebe034e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.557565] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-5dc09d14-4eb1-43e1-87d3-6f459ebe034e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.557933] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-5dc09d14-4eb1-43e1-87d3-6f459ebe034e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.558128] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dc09d14-4eb1-43e1-87d3-6f459ebe034e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.592261] env[69559]: INFO networking_nsxv3.common.synchronization [req-de933252-8a97-4ef2-82eb-c3f1d093395b req-1df865d7-f3f6-4317-a770-b041c4fa55ab tempest-ImagesOneServerNegativeTestJSON-1590344667 tempest-ImagesOneServerNegativeTestJSON-1590344667-project-member] Enqueued Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_members [ 1097.592737] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_members [ 1097.593103] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.593266] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.593340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.593549] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.593715] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.594780] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.594872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.595022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.595114] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.595201] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.651300] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.651458] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.651502] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.651710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.651810] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.652010] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.652138] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.652196] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.652349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.652424] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.652507] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 already deleted. [ 1097.652582] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.059986] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.060283] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.060405] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.060695] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.060860] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.061083] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 5dc09d14-4eb1-43e1-87d3-6f459ebe034e not found, creating... [ 1098.061384] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.061574] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.061771] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.062051] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.062213] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.062520] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.062683] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.062807] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.063035] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.063179] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.063341] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 5dc09d14-4eb1-43e1-87d3-6f459ebe034e is going to be created. [ 1098.082905] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.083154] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.083287] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.083539] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.083773] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.083994] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-5dc09d14-4eb1-43e1-87d3-6f459ebe034e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.098136] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.098280] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.098351] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.098543] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.098631] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.098815] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.098913] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.098976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.099130] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.099203] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.099288] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b4e023e-3f17-4641-b235-16fa1645d85a is going to be updated. [ 1098.129176] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.129379] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.129418] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.129630] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.129736] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.138435] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b4e023e-3f17-4641-b235-16fa1645d85a in Status: IN_PROGRESS for 2s [ 1098.148096] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: SUCCESS [ 1098.148386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.775967] env[69559]: INFO networking_nsxv3.common.synchronization [req-bb6079e1-04c3-4fb3-9856-f56b6f375db4 req-ab2004e7-0a31-418e-8e8a-a4b20d886493 service nova] Enqueued Resource ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 with Priority: HIGHEST for action security_group_rules [ 1098.776171] env[69559]: INFO networking_nsxv3.common.synchronization [req-bb6079e1-04c3-4fb3-9856-f56b6f375db4 req-ab2004e7-0a31-418e-8e8a-a4b20d886493 service nova] Enqueued Resource ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 with Priority: HIGHEST for action security_group_members [ 1098.776317] env[69559]: INFO networking_nsxv3.common.synchronization [req-bb6079e1-04c3-4fb3-9856-f56b6f375db4 req-ab2004e7-0a31-418e-8e8a-a4b20d886493 service nova] Enqueued Resource ID: 5dc09d14-4eb1-43e1-87d3-6f459ebe034e with Priority: HIGHEST for action port [ 1098.776529] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 with Priority: HIGHEST for action security_group_rules [ 1098.776850] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 with Priority: HIGHEST for action security_group_members [ 1098.776850] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dc09d14-4eb1-43e1-87d3-6f459ebe034e with Priority: HIGHEST for action port [ 1098.777360] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c048f2fc-8707-43d6-b2f1-033edda0ea00 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.777478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.777573] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.777801] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.777903] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c048f2fc-8707-43d6-b2f1-033edda0ea00',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.779236] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c048f2fc-8707-43d6-b2f1-033edda0ea00 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.779337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.779375] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.779684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.779837] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.779937] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.780031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.780229] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.780340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.780481] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c048f2fc-8707-43d6-b2f1-033edda0ea00',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.781219] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-5dc09d14-4eb1-43e1-87d3-6f459ebe034e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.781321] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5dc09d14-4eb1-43e1-87d3-6f459ebe034e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.781554] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5dc09d14-4eb1-43e1-87d3-6f459ebe034e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.781554] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5dc09d14-4eb1-43e1-87d3-6f459ebe034e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.781615] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dc09d14-4eb1-43e1-87d3-6f459ebe034e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.034149] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 1099.034301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.034469] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.034711] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.034909] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.035044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.035111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.035308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.035395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.035486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.035574] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.284314] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c048f2fc-8707-43d6-b2f1-033edda0ea00 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.284314] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.284314] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c048f2fc-8707-43d6-b2f1-033edda0ea00',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.285501] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5dc09d14-4eb1-43e1-87d3-6f459ebe034e with status ACTIVE [ 1099.285501] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.285501] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.285501] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.285731] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.285765] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.285941] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.286049] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.286112] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.286265] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.286345] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.286566] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.286622] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.286666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.286810] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.286872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.286980] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5dc09d14-4eb1-43e1-87d3-6f459ebe034e is going to be updated. [ 1099.307403] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.307554] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.307604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.307804] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.307936] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.308106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5dc09d14-4eb1-43e1-87d3-6f459ebe034e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.364301] env[69559]: INFO networking_nsxv3.common.synchronization [req-6e78b440-13a7-4172-9303-6ba4a35732bc req-f1e3fddd-3134-490b-be0e-4581f299a8b5 tempest-MultipleCreateTestJSON-687420967 tempest-MultipleCreateTestJSON-687420967-project-member] Enqueued Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1099.364832] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1099.365153] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.365275] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.365347] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.366209] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.366209] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.366209] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.366209] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.366209] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.366209] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.366209] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.538935] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.539119] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.539162] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.539387] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.539649] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.539760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.539760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.539898] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.539986] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.540121] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.540452] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.540452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.540452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.540599] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.540693] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.540784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.540846] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.541061] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.541140] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.541221] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.541309] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.664447] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-441 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.664447] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-441" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.664447] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-441" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.664447] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-441" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.665823] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.665823] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.665823] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.666256] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.666326] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.666513] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1099.666655] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1099.666781] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1099.666889] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1099.667032] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1099.667190] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1099.667359] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1099.687369] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1099.687586] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1099.687742] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1099.687969] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-441" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.688364] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-52e0386c-b1bb-4f8d-8b57-c89aeeb501da taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.688546] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-52e0386c-b1bb-4f8d-8b57-c89aeeb501da" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.688695] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-52e0386c-b1bb-4f8d-8b57-c89aeeb501da" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.689165] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-52e0386c-b1bb-4f8d-8b57-c89aeeb501da" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.689352] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52e0386c-b1bb-4f8d-8b57-c89aeeb501da',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.789578] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c048f2fc-8707-43d6-b2f1-033edda0ea00',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.868765] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.868926] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.869023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.869280] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.869668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.869668] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.869781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.869781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.870268] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.870268] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.870268] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a already deleted. [ 1099.870268] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.043803] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 839ae40b-5f13-4259-8e2a-b943b206557d: rpc.has_security_group_logging(os_id): False [ 1100.063440] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.063657] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.063657] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.063850] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.063944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.064180] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.064287] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.064350] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.064499] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.064577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.064764] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.064860] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.064921] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.065117] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.065198] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.065380] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.065473] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.065533] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.065671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.065744] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.065828] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be updated. [ 1100.124708] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.124902] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.124902] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.125141] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.125287] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.137476] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 1100.145165] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b4e023e-3f17-4641-b235-16fa1645d85a in Status: IN_PROGRESS for 4s [ 1100.193361] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.193361] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.193361] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.193361] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.193361] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.193361] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 52e0386c-b1bb-4f8d-8b57-c89aeeb501da not found, creating... [ 1100.193593] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.193748] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.193876] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.194125] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.194272] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.194562] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.194722] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.194863] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.198545] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.198743] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.198933] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 52e0386c-b1bb-4f8d-8b57-c89aeeb501da is going to be created. [ 1100.245058] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.245307] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.245438] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.245727] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.245965] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.246289] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-52e0386c-b1bb-4f8d-8b57-c89aeeb501da" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.293457] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.293726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.293726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.293865] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.293865] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.294112] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 is going to be created. [ 1100.328547] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.328690] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.328758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.328995] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.329178] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.343044] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 in Status: UNINITIALIZED for 2s [ 1100.886020] env[69559]: INFO networking_nsxv3.common.synchronization [req-6e78b440-13a7-4172-9303-6ba4a35732bc req-037b142e-0fbf-43b2-a135-67f48f8d8861 service nova] Enqueued Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_rules [ 1100.886020] env[69559]: INFO networking_nsxv3.common.synchronization [req-6e78b440-13a7-4172-9303-6ba4a35732bc req-037b142e-0fbf-43b2-a135-67f48f8d8861 service nova] Enqueued Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1100.886149] env[69559]: INFO networking_nsxv3.common.synchronization [req-6e78b440-13a7-4172-9303-6ba4a35732bc req-037b142e-0fbf-43b2-a135-67f48f8d8861 service nova] Enqueued Resource ID: 52e0386c-b1bb-4f8d-8b57-c89aeeb501da with Priority: HIGHEST for action port [ 1100.886383] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_rules [ 1100.886510] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1100.886607] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52e0386c-b1bb-4f8d-8b57-c89aeeb501da with Priority: HIGHEST for action port [ 1100.887245] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.887316] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.887353] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.887609] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.887687] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.888529] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.891019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.891019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.891019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.891019] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.891019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.891019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.891019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.891019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.891019] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.891019] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-52e0386c-b1bb-4f8d-8b57-c89aeeb501da taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.891019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52e0386c-b1bb-4f8d-8b57-c89aeeb501da" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.891019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52e0386c-b1bb-4f8d-8b57-c89aeeb501da" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.891019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52e0386c-b1bb-4f8d-8b57-c89aeeb501da" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.891019] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52e0386c-b1bb-4f8d-8b57-c89aeeb501da',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.395883] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.395883] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.395883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.395883] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52e0386c-b1bb-4f8d-8b57-c89aeeb501da with status ACTIVE [ 1101.395883] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.395883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.395883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.396400] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.396400] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.396400] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.396496] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.396496] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.397171] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.397171] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.397171] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.397352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.397469] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.397692] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.398553] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.398553] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52e0386c-b1bb-4f8d-8b57-c89aeeb501da is going to be updated. [ 1101.419426] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.419578] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.419650] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.419850] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.419983] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.420150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52e0386c-b1bb-4f8d-8b57-c89aeeb501da" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.901106] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.150856] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 1102.151137] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.152550] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b4e023e-3f17-4641-b235-16fa1645d85a in Status: SUCCESS [ 1102.152699] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b4e023e-3f17-4641-b235-16fa1645d85a deletion is rescheduled due to dependency. [ 1102.152797] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.352294] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 in Status: SUCCESS [ 1102.352539] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.352701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.352924] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.353121] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.353243] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.353309] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.353458] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.353536] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.353620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.353708] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c048f2fc-8707-43d6-b2f1-033edda0ea00',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.378549] env[69559]: INFO networking_nsxv3.common.synchronization [req-6e78b440-13a7-4172-9303-6ba4a35732bc req-dd260259-bab7-4e77-8e29-525f592a9617 tempest-MultipleCreateTestJSON-687420967 tempest-MultipleCreateTestJSON-687420967-project-member] Enqueued Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1102.379229] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1102.379553] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.379699] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.403899] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.403899] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.403899] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.403899] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.403899] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.404391] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a is going to be created. [ 1102.425547] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.425758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.425758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.426050] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.426216] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.435844] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: UNINITIALIZED for 2s [ 1102.794564] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-441 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.794736] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-441" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.794867] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-441" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.795161] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-441" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.795568] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.795734] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.795861] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.796100] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.796257] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.796465] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1102.796586] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1102.796702] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1102.796817] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1102.796945] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1102.797065] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1102.797206] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1102.813993] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1102.814248] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1102.814422] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1102.814664] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-441" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.815047] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-3cef2d54-9f0e-4f47-bda5-f47c61572c04 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.815269] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-3cef2d54-9f0e-4f47-bda5-f47c61572c04" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.815376] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-3cef2d54-9f0e-4f47-bda5-f47c61572c04" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.816077] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-3cef2d54-9f0e-4f47-bda5-f47c61572c04" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.816274] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cef2d54-9f0e-4f47-bda5-f47c61572c04',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.856042] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c048f2fc-8707-43d6-b2f1-033edda0ea00',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.319899] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.319899] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.319899] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.319899] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.319899] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.320235] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 3cef2d54-9f0e-4f47-bda5-f47c61572c04 not found, creating... [ 1103.320390] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.320535] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.320664] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.320884] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.321067] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.321375] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.321567] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.321709] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.321934] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.322089] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.322237] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 3cef2d54-9f0e-4f47-bda5-f47c61572c04 is going to be created. [ 1103.341298] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.341541] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.341673] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.341937] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.342185] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.342412] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-3cef2d54-9f0e-4f47-bda5-f47c61572c04" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.357983] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c048f2fc-8707-43d6-b2f1-033edda0ea00: rpc.has_security_group_logging(os_id): False [ 1103.375455] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.375616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.375657] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.375858] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.375945] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.376200] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.376301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.376384] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.376505] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.376582] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.376667] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 is going to be created. [ 1103.444906] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.445298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.445337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.445699] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.446389] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.459813] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 in Status: IN_PROGRESS for 2s [ 1104.126492] env[69559]: INFO networking_nsxv3.common.synchronization [req-6e78b440-13a7-4172-9303-6ba4a35732bc req-a50083a8-bd9b-4c6f-9760-80e9c0c52cd3 service nova] Enqueued Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_rules [ 1104.126725] env[69559]: INFO networking_nsxv3.common.synchronization [req-6e78b440-13a7-4172-9303-6ba4a35732bc req-a50083a8-bd9b-4c6f-9760-80e9c0c52cd3 service nova] Enqueued Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1104.126924] env[69559]: INFO networking_nsxv3.common.synchronization [req-6e78b440-13a7-4172-9303-6ba4a35732bc req-a50083a8-bd9b-4c6f-9760-80e9c0c52cd3 service nova] Enqueued Resource ID: 3cef2d54-9f0e-4f47-bda5-f47c61572c04 with Priority: HIGHEST for action port [ 1104.127508] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_rules [ 1104.127646] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1104.127790] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cef2d54-9f0e-4f47-bda5-f47c61572c04 with Priority: HIGHEST for action port [ 1104.128064] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.128278] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.128423] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.128515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.128695] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cef2d54-9f0e-4f47-bda5-f47c61572c04 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.128792] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cef2d54-9f0e-4f47-bda5-f47c61572c04" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.128886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cef2d54-9f0e-4f47-bda5-f47c61572c04" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.129193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cef2d54-9f0e-4f47-bda5-f47c61572c04" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.129278] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cef2d54-9f0e-4f47-bda5-f47c61572c04',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.445232] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: SUCCESS [ 1104.445554] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.445624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.445839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.446035] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.446158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.446223] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.446394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.446481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.446569] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.446666] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.447576] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.447660] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.447788] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.447892] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.447962] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.448108] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.448179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.448260] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.632196] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3cef2d54-9f0e-4f47-bda5-f47c61572c04 with status ACTIVE [ 1104.632472] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.632571] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.632644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.632864] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.632985] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.633189] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.633291] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.633354] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.633504] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.633578] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.633757] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.633862] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.633921] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.634076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.634152] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.634237] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3cef2d54-9f0e-4f47-bda5-f47c61572c04 is going to be updated. [ 1104.657716] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.657863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.657990] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.658156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.658293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.658451] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cef2d54-9f0e-4f47-bda5-f47c61572c04" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.746337] env[69559]: INFO networking_nsxv3.common.synchronization [req-7428d13c-15ec-4281-9850-2e2307a92eb9 req-4be9382c-2f70-4731-b76d-bf7a0fc5d699 tempest-ServersTestJSON-514909010 tempest-ServersTestJSON-514909010-project-member] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1104.746337] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1104.746337] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.746337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.746337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.746337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.746337] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.746337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.746337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.746337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.746337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.746337] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.949618] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.949755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.949960] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.040236] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-640 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.040658] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.040658] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.040855] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.041239] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.041463] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.041630] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.041891] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.042098] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.042339] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1105.042499] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1105.043031] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1105.043031] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1105.043031] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1105.043031] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1105.043180] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1105.060403] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1105.061513] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1105.061513] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1105.061513] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.061513] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-38b562bd-fda5-4398-891d-418383088494 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.061513] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-38b562bd-fda5-4398-891d-418383088494" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.061808] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-38b562bd-fda5-4398-891d-418383088494" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.062560] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-38b562bd-fda5-4398-891d-418383088494" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.062560] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38b562bd-fda5-4398-891d-418383088494',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.250292] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.453084] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.472798] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 in Status: SUCCESS [ 1105.473079] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.564356] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.564601] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.564737] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.565041] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.565204] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.565369] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 38b562bd-fda5-4398-891d-418383088494 not found, creating... [ 1105.565647] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.565825] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.565954] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.566202] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.566363] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.566639] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.566800] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.566926] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.567158] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.567301] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.567477] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 38b562bd-fda5-4398-891d-418383088494 is going to be created. [ 1105.589269] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.589367] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.589490] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.589772] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.590021] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.590263] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-38b562bd-fda5-4398-891d-418383088494" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.752112] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.955500] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.955686] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.955764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.956055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.956205] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.956308] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a is going to be updated. [ 1105.985463] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.985669] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.985738] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.985991] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.986158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.994225] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: IN_PROGRESS for 2s [ 1106.256394] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.256394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.256394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.256394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.256394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.256394] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1106.285033] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.285033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.285033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.285033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.285033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.294634] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1106.297179] env[69559]: INFO networking_nsxv3.common.synchronization [req-7428d13c-15ec-4281-9850-2e2307a92eb9 req-69368e76-5af7-4f16-b322-9cee0964151a service nova] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_rules [ 1106.298098] env[69559]: INFO networking_nsxv3.common.synchronization [req-7428d13c-15ec-4281-9850-2e2307a92eb9 req-69368e76-5af7-4f16-b322-9cee0964151a service nova] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1106.298098] env[69559]: INFO networking_nsxv3.common.synchronization [req-7428d13c-15ec-4281-9850-2e2307a92eb9 req-69368e76-5af7-4f16-b322-9cee0964151a service nova] Enqueued Resource ID: 38b562bd-fda5-4398-891d-418383088494 with Priority: HIGHEST for action port [ 1106.298647] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_rules [ 1106.299033] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1106.299333] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b562bd-fda5-4398-891d-418383088494 with Priority: HIGHEST for action port [ 1106.300811] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.300811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.300811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.300811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.300811] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.301995] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.302194] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.302450] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-38b562bd-fda5-4398-891d-418383088494 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.302606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38b562bd-fda5-4398-891d-418383088494" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.302712] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38b562bd-fda5-4398-891d-418383088494" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.302942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38b562bd-fda5-4398-891d-418383088494" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.303079] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38b562bd-fda5-4398-891d-418383088494',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.806684] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.806978] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.807072] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38b562bd-fda5-4398-891d-418383088494 with status ACTIVE [ 1106.807235] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.807342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.807402] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.807611] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.807700] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.807873] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.807970] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.808053] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.808322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.808322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.808468] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.808579] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.808628] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.808772] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.808848] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.808933] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38b562bd-fda5-4398-891d-418383088494 is going to be updated. [ 1106.833133] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.833406] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.833406] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.833580] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.833722] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.833929] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38b562bd-fda5-4398-891d-418383088494" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.005053] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: SUCCESS [ 1108.005053] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.005053] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.005053] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.005053] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.005730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.005730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.005730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.005730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.005730] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.305167] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1108.305465] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.305690] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.305960] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.306257] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.306418] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.306518] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.306718] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.306810] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.306923] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.507811] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.809154] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.010766] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.310841] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.513316] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.513483] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.513547] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.513779] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.513852] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.514130] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a is going to be updated. [ 1109.540951] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.541117] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.541192] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.541430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.541577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.549204] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: IN_PROGRESS for 2s [ 1109.814218] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.814380] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.814464] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.814671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.814755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.814851] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1109.843745] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.843890] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.843944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.844486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.844660] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.854104] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1110.912116] env[69559]: INFO networking_nsxv3.common.synchronization [req-57dfb83c-ecbc-490b-9a0c-d6aad78e2bcc req-5eda462b-a167-47fe-97f6-18bd6c05f137 tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGHEST for action security_group_members [ 1110.912758] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGHEST for action security_group_members [ 1110.913065] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.913305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.913381] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.913678] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.913881] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.914026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.914104] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.914285] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.914371] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.914470] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.231990] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.232113] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.232195] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.232474] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.232740] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.232940] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.233591] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.233591] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.233591] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.233759] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1111.233841] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1111.233947] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1111.234110] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1111.234175] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1111.234290] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1111.234431] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1111.253751] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1111.253957] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1111.254144] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1111.254357] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.254741] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-93bfe6c0-4d20-4378-a94b-e83721e22f68 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.254966] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-93bfe6c0-4d20-4378-a94b-e83721e22f68" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.255148] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-93bfe6c0-4d20-4378-a94b-e83721e22f68" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.255519] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-93bfe6c0-4d20-4378-a94b-e83721e22f68" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.255692] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93bfe6c0-4d20-4378-a94b-e83721e22f68',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.416576] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.416729] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.416771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.417073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.417175] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.417378] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.417497] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.417553] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.417712] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.417791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.417876] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 already deleted. [ 1111.417959] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.559571] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: SUCCESS [ 1111.559863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.560085] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.560345] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.560558] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.560827] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.560827] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.560985] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.561113] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.561209] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.561417] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.561521] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.561586] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.561764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.561953] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.562129] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.562221] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.562303] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.562417] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.562526] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.562622] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.758418] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.758811] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.758911] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.759258] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.759495] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.759686] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 93bfe6c0-4d20-4378-a94b-e83721e22f68 not found, creating... [ 1111.759965] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.760162] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.760289] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.760566] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.760719] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.761101] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.761261] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.761387] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.761602] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.761764] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.761912] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 93bfe6c0-4d20-4378-a94b-e83721e22f68 is going to be created. [ 1111.785179] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.785412] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.785545] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.785804] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.786089] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.786358] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-93bfe6c0-4d20-4378-a94b-e83721e22f68" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.864319] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1111.864413] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.864559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.864786] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.865305] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.865442] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.865504] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.865672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.865754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.865840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.865929] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.065424] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d52f1e04-af0f-4b37-a85f-0fe71f26399a: rpc.has_security_group_logging(os_id): False [ 1112.082227] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.082386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.082386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.082593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.082680] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.082868] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.082966] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.083041] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.083191] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.083271] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.083508] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.083608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.083673] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.083815] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.083889] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.084079] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.084174] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.084235] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.084373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.084445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.084526] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a is going to be created. [ 1112.139251] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.139477] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.139477] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.139710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.139888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.149736] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: IN_PROGRESS for 2s [ 1112.368288] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.368455] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.368533] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.368749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.368917] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.369049] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.369147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.369253] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.369340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.369478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.369578] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.369665] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.369727] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.369869] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.370020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.370190] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.370190] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.370309] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.370393] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.370468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.370577] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.519102] env[69559]: INFO networking_nsxv3.common.synchronization [req-57dfb83c-ecbc-490b-9a0c-d6aad78e2bcc req-c065af07-ae3f-4ccd-a701-e61d1d2a3280 service nova] Enqueued Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGHEST for action security_group_rules [ 1112.519250] env[69559]: INFO networking_nsxv3.common.synchronization [req-57dfb83c-ecbc-490b-9a0c-d6aad78e2bcc req-c065af07-ae3f-4ccd-a701-e61d1d2a3280 service nova] Enqueued Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGHEST for action security_group_members [ 1112.519840] env[69559]: INFO networking_nsxv3.common.synchronization [req-57dfb83c-ecbc-490b-9a0c-d6aad78e2bcc req-c065af07-ae3f-4ccd-a701-e61d1d2a3280 service nova] Enqueued Resource ID: 93bfe6c0-4d20-4378-a94b-e83721e22f68 with Priority: HIGHEST for action port [ 1112.519993] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGHEST for action security_group_rules [ 1112.520717] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGHEST for action security_group_members [ 1112.520717] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93bfe6c0-4d20-4378-a94b-e83721e22f68 with Priority: HIGHEST for action port [ 1112.520717] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.520887] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.520923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.521220] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.521350] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.525022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.525022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.525022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.525022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.525022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.525022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.525022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.525022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.525022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.525022] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.525022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-93bfe6c0-4d20-4378-a94b-e83721e22f68 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.525022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93bfe6c0-4d20-4378-a94b-e83721e22f68" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.525022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93bfe6c0-4d20-4378-a94b-e83721e22f68" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.525022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93bfe6c0-4d20-4378-a94b-e83721e22f68" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.525022] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93bfe6c0-4d20-4378-a94b-e83721e22f68',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.872646] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebf5f404-8f48-487f-b212-72786dc389e8: rpc.has_security_group_logging(os_id): False [ 1112.889716] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.889943] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.890127] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.890380] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.890481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.890682] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.890782] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.890848] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.891008] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.891106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.891309] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.891404] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.891462] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.891819] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.891819] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.891873] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.891922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.892082] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.892142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.892243] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.892362] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1112.957200] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.957464] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.957464] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.957642] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.957787] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.970766] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1113.025696] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.025843] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.026008] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.026926] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 93bfe6c0-4d20-4378-a94b-e83721e22f68 with status ACTIVE [ 1113.027116] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.027253] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.027311] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.027496] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.027581] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.027747] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.027841] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.027905] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.028068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.028166] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.028418] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.028474] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.028508] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.028626] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.028699] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.028794] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 93bfe6c0-4d20-4378-a94b-e83721e22f68 is going to be updated. [ 1113.059871] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.060108] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.060108] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.060293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.060425] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.060594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93bfe6c0-4d20-4378-a94b-e83721e22f68" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.530845] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.032901] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.033063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.033137] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.033329] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.033418] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.033514] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 is going to be created. [ 1114.056807] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.056954] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.057034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.057244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.057401] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.065460] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 in Status: UNINITIALIZED for 2s [ 1114.169947] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: SUCCESS [ 1114.170203] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.170380] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.170602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.170692] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.673610] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.674010] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.674010] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.674096] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.674303] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.674416] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.674479] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.674645] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.674734] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.674821] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.674911] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.985255] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1114.985593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.083766] env[69559]: INFO networking_nsxv3.common.synchronization [req-edaef9be-7e95-4453-a69a-7cffe67b74de req-5d1c0d6c-3af4-4ff4-9020-932a36b0ae91 tempest-MultipleCreateTestJSON-687420967 tempest-MultipleCreateTestJSON-687420967-project-member] Enqueued Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1115.084900] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1115.084900] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.084900] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.084900] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.085409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.089044] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.089044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.089044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.089044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.089044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.089044] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.139632] env[69559]: INFO networking_nsxv3.common.synchronization [req-93e1c466-4fb6-4ab4-8d73-3139411a5756 req-57fc5afc-d5ba-4078-b661-71200d16c858 tempest-MultipleCreateTestJSON-687420967 tempest-MultipleCreateTestJSON-687420967-project-member] Enqueued Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1115.139797] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1115.140584] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.140584] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.176936] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.176936] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.589340] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.994019] env[69559]: INFO networking_nsxv3.common.synchronization [req-e83977d8-0541-4eb9-9323-5861e733e337 req-e468a48b-0851-49b7-8256-671a931fd829 tempest-ImagesOneServerNegativeTestJSON-1590344667 tempest-ImagesOneServerNegativeTestJSON-1590344667-project-member] Enqueued Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_members [ 1115.994019] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_members [ 1115.994019] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.994019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.994019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.994019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.994699] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.994914] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.995075] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.995315] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.995494] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.995697] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.075508] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 in Status: SUCCESS [ 1116.075738] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.075896] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.076128] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.076322] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.076440] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.076503] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.076651] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.076733] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.076853] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.076919] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.090714] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.278401] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-114 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.278620] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-114" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.278753] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-114" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.279036] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-114" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.279332] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.279500] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.279624] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.280265] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.280433] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.280654] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1116.280794] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1116.280897] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1116.281024] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1116.281183] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1116.281303] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1116.281446] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1116.302208] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1116.302471] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1116.302595] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1116.302783] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-114" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.303158] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-39b5b734-d644-4aec-bb7c-a104f77dfc6c taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.303354] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-39b5b734-d644-4aec-bb7c-a104f77dfc6c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.303482] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-39b5b734-d644-4aec-bb7c-a104f77dfc6c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.303838] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-39b5b734-d644-4aec-bb7c-a104f77dfc6c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.303982] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39b5b734-d644-4aec-bb7c-a104f77dfc6c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.500789] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.500789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.500789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.500789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.500789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.500789] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.500789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.500789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.500789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.500789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.500789] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b4e023e-3f17-4641-b235-16fa1645d85a is going to be updated. [ 1116.527063] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.527257] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.527307] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.527530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.527679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.535836] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b4e023e-3f17-4641-b235-16fa1645d85a in Status: IN_PROGRESS for 2s [ 1116.579294] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.593192] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.593446] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.593446] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.593635] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.593726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.593823] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a is going to be updated. [ 1116.623572] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.623716] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.623788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.623995] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.624147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.631962] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: IN_PROGRESS for 2s [ 1116.806720] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.806967] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.807125] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.807471] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.807633] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.807796] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 39b5b734-d644-4aec-bb7c-a104f77dfc6c not found, creating... [ 1116.808087] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.808270] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.808398] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.808619] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.808760] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.809097] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.809228] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.809379] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.809606] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.809748] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.809895] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 39b5b734-d644-4aec-bb7c-a104f77dfc6c is going to be created. [ 1116.827709] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.827937] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.828153] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.828415] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.828706] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.829017] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-39b5b734-d644-4aec-bb7c-a104f77dfc6c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.081152] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7: rpc.has_security_group_logging(os_id): False [ 1117.101021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.101021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.101021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.101021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.101021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.101021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.101021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.101021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.101021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.101021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.101021] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 is going to be created. [ 1117.154209] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.154476] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.154476] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.154761] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.155009] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.167147] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 in Status: IN_PROGRESS for 2s [ 1117.521435] env[69559]: INFO networking_nsxv3.common.synchronization [req-e83977d8-0541-4eb9-9323-5861e733e337 req-31081ff9-3cb2-407f-ae2b-8697de5d02da service nova] Enqueued Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_rules [ 1117.521629] env[69559]: INFO networking_nsxv3.common.synchronization [req-e83977d8-0541-4eb9-9323-5861e733e337 req-31081ff9-3cb2-407f-ae2b-8697de5d02da service nova] Enqueued Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_members [ 1117.521775] env[69559]: INFO networking_nsxv3.common.synchronization [req-e83977d8-0541-4eb9-9323-5861e733e337 req-31081ff9-3cb2-407f-ae2b-8697de5d02da service nova] Enqueued Resource ID: 39b5b734-d644-4aec-bb7c-a104f77dfc6c with Priority: HIGHEST for action port [ 1117.522311] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_rules [ 1117.522449] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_members [ 1117.522556] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b5b734-d644-4aec-bb7c-a104f77dfc6c with Priority: HIGHEST for action port [ 1117.522866] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.522991] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.523056] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.523259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.523342] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.526016] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.526016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.526016] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-39b5b734-d644-4aec-bb7c-a104f77dfc6c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.526016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39b5b734-d644-4aec-bb7c-a104f77dfc6c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.526016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39b5b734-d644-4aec-bb7c-a104f77dfc6c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.526016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39b5b734-d644-4aec-bb7c-a104f77dfc6c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.526016] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39b5b734-d644-4aec-bb7c-a104f77dfc6c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.026758] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.026919] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.027111] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39b5b734-d644-4aec-bb7c-a104f77dfc6c with status ACTIVE [ 1118.027284] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.027395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.027464] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.027665] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.027757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.027925] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.028029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.028094] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.028275] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.028325] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.028494] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.028612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.028655] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.028773] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.028848] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.028929] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39b5b734-d644-4aec-bb7c-a104f77dfc6c is going to be updated. [ 1118.052876] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.053062] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.053104] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.053299] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.053431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.053590] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39b5b734-d644-4aec-bb7c-a104f77dfc6c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.265289] env[69559]: INFO networking_nsxv3.common.synchronization [req-35ec2423-7073-45f4-8168-ae8cb962effe req-8800ee81-22ad-437e-9e1b-0e1eeb95fedd tempest-ServersTestJSON-514909010 tempest-ServersTestJSON-514909010-project-member] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1118.265806] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1118.266367] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.266367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.266367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.266646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.266646] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.266714] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.266785] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.266908] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.266988] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.267091] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.548468] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b4e023e-3f17-4641-b235-16fa1645d85a in Status: SUCCESS [ 1118.548701] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b4e023e-3f17-4641-b235-16fa1645d85a deletion is rescheduled due to dependency. [ 1118.548813] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.548869] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.549133] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.549321] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.549439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.549504] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.549652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.549734] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.549829] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.645399] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: SUCCESS [ 1118.645651] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.645849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.646086] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.646272] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.646390] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.646454] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.646628] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.646708] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.646799] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.769496] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.051900] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.149213] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.149213] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.149978] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.149978] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.149978] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.150316] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.150316] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.150421] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.150526] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.150608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.150713] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a is going to be updated. [ 1119.176936] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.177103] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.177175] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.177370] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.177515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.178971] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 in Status: SUCCESS [ 1119.179191] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.185338] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: IN_PROGRESS for 2s [ 1119.271523] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.554601] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.773803] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.773984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.774075] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.774293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.774380] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.774475] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1119.801203] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.801382] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.801436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.801649] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.801794] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.811544] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1120.056811] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.056989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.057079] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.057310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.057466] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.057542] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b4e023e-3f17-4641-b235-16fa1645d85a is going to be updated. [ 1120.084979] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.085128] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.085255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.085388] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.085529] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.093326] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b4e023e-3f17-4641-b235-16fa1645d85a in Status: IN_PROGRESS for 2s [ 1121.198018] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: SUCCESS [ 1121.198018] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a deletion is rescheduled due to dependency. [ 1121.198018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.198018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.198018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.198018] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.198018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.198018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.198018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.198018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.198018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.198018] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.198018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.198018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.198018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.198018] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.198018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.198018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.198804] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.198887] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.198980] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.199168] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.702158] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d52f1e04-af0f-4b37-a85f-0fe71f26399a: rpc.has_security_group_logging(os_id): False [ 1121.718806] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.718974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.719118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.719351] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.719445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.719671] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.719804] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.719955] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.720032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.720125] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.720334] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.720433] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.720490] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.720632] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.720694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.720878] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.720962] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.721068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.721266] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.721354] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.721404] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a is going to be updated. [ 1121.783330] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.783623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.783623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.783906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.784058] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.796301] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: IN_PROGRESS for 2s [ 1121.828434] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1121.828683] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.102937] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b4e023e-3f17-4641-b235-16fa1645d85a in Status: SUCCESS [ 1122.103220] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.103389] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.103650] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.103855] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.103972] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.104251] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.104251] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.104357] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.104357] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.104452] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.607647] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.607957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.607957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.608121] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.608309] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.608433] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.609023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.609023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.609023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.609023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.609023] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.609323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.609323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.609323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.609449] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.609498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.609562] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.609697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.609846] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.609846] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.609994] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.112205] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b4e023e-3f17-4641-b235-16fa1645d85a: rpc.has_security_group_logging(os_id): False [ 1123.135308] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.135409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.135483] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.135765] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.135865] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.136150] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.136272] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.136321] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.136471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.136554] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.136735] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.136830] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.136891] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.137039] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.137115] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.137295] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.137452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.137499] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.137612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.137759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.137811] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b4e023e-3f17-4641-b235-16fa1645d85a is going to be updated. [ 1123.204395] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.204606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.204733] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.205047] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.205264] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.221515] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b4e023e-3f17-4641-b235-16fa1645d85a in Status: IN_PROGRESS for 2s [ 1123.266980] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1123.267094] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1123.813736] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: SUCCESS [ 1123.814148] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.048503] env[69559]: INFO networking_nsxv3.common.synchronization [req-5a4869a4-7f84-4d9c-a514-e0791e8517af req-b88a5ae2-70c5-417f-b4c6-d49a38972e8c tempest-ServersTestJSON-514909010 tempest-ServersTestJSON-514909010-project-member] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1125.049282] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1125.049367] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.049530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.049629] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.050057] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.050272] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.050409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.050491] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.050699] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.050792] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.050930] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.184125] env[69559]: INFO networking_nsxv3.common.synchronization [req-28b678b3-35ed-49b5-b0ed-f8aec2fbbaa9 req-b6467b56-5609-4317-9919-4705b6049bf6 tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGHEST for action security_group_members [ 1125.184125] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGHEST for action security_group_members [ 1125.184293] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.184359] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.184439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.184620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.184763] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.184855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.184915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.185163] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.185250] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.185345] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.239067] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b4e023e-3f17-4641-b235-16fa1645d85a in Status: SUCCESS [ 1125.239284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.458271] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.459157] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.459157] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.459157] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.459312] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.459472] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.459599] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.459840] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.459994] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.460226] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1125.460512] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1125.460512] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1125.460579] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1125.460685] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1125.460794] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1125.460929] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1125.480281] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1125.480435] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1125.480579] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1125.480754] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.481119] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-0de73a32-ccc2-4b94-b77f-300d55ae46f1 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.481395] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-0de73a32-ccc2-4b94-b77f-300d55ae46f1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.481481] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-0de73a32-ccc2-4b94-b77f-300d55ae46f1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.481796] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-0de73a32-ccc2-4b94-b77f-300d55ae46f1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.481938] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0de73a32-ccc2-4b94-b77f-300d55ae46f1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.553566] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.687477] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.984687] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.985079] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.985305] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.985727] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.985942] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.986226] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 0de73a32-ccc2-4b94-b77f-300d55ae46f1 not found, creating... [ 1125.986653] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.987133] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.987133] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.987481] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.987728] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.991019] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.991019] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.991019] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.991019] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.991019] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.991019] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 0de73a32-ccc2-4b94-b77f-300d55ae46f1 is going to be created. [ 1126.012325] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.012611] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.012753] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.013038] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.013280] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.013515] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-0de73a32-ccc2-4b94-b77f-300d55ae46f1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.056447] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.190201] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.558571] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.559671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.559671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.559671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.559671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.559671] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1126.588156] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.588303] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.588389] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.589012] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.589147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.598072] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1126.694111] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.694111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.694111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.694111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.694111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.694111] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 is going to be updated. [ 1126.700152] env[69559]: INFO networking_nsxv3.common.synchronization [req-28b678b3-35ed-49b5-b0ed-f8aec2fbbaa9 req-482eb005-917a-428e-8d1f-0851b7a73303 service nova] Enqueued Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGHEST for action security_group_rules [ 1126.700343] env[69559]: INFO networking_nsxv3.common.synchronization [req-28b678b3-35ed-49b5-b0ed-f8aec2fbbaa9 req-482eb005-917a-428e-8d1f-0851b7a73303 service nova] Enqueued Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGHEST for action security_group_members [ 1126.700485] env[69559]: INFO networking_nsxv3.common.synchronization [req-28b678b3-35ed-49b5-b0ed-f8aec2fbbaa9 req-482eb005-917a-428e-8d1f-0851b7a73303 service nova] Enqueued Resource ID: 0de73a32-ccc2-4b94-b77f-300d55ae46f1 with Priority: HIGHEST for action port [ 1126.700710] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGHEST for action security_group_rules [ 1126.700842] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGHEST for action security_group_members [ 1126.700936] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0de73a32-ccc2-4b94-b77f-300d55ae46f1 with Priority: HIGHEST for action port [ 1126.701549] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.701674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.701744] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.701936] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.703224] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.704149] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.704273] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.704445] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-0de73a32-ccc2-4b94-b77f-300d55ae46f1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.704541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0de73a32-ccc2-4b94-b77f-300d55ae46f1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.704614] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0de73a32-ccc2-4b94-b77f-300d55ae46f1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.704774] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0de73a32-ccc2-4b94-b77f-300d55ae46f1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.704847] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0de73a32-ccc2-4b94-b77f-300d55ae46f1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.721819] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.721981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.722032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.722369] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.722568] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.732520] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 in Status: IN_PROGRESS for 2s [ 1127.121888] env[69559]: INFO networking_nsxv3.common.synchronization [req-e4c6c1b2-b796-4363-9529-613a6574f360 req-5a7759d6-bb5b-462c-af0a-44ea57850db8 tempest-MultipleCreateTestJSON-687420967 tempest-MultipleCreateTestJSON-687420967-project-member] Enqueued Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1127.122704] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1127.122787] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.122887] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.122950] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.123157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.123304] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.124142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.124142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.124142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.124142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.124142] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.210043] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.210043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.210043] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0de73a32-ccc2-4b94-b77f-300d55ae46f1 with status ACTIVE [ 1127.210043] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.210043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.210043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.210043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.210043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.210043] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.210043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.210043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.210043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.210043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.210043] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.210558] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.210558] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.210558] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.210558] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.210558] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0de73a32-ccc2-4b94-b77f-300d55ae46f1 is going to be updated. [ 1127.229467] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.229597] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.229670] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.229859] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.229999] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.230162] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0de73a32-ccc2-4b94-b77f-300d55ae46f1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.406999] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-441 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.407247] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-441" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.407384] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-441" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.407650] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-441" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.407912] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.408085] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.408230] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.408455] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.408607] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.408815] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.408933] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1127.409061] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1127.409208] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1127.409336] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.409452] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1127.409592] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1127.430314] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1127.430515] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1127.430656] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1127.430827] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-441" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.431257] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-ea49cf16-2390-4c43-a4f8-00fad9aafd2e taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.431503] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-ea49cf16-2390-4c43-a4f8-00fad9aafd2e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.431657] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-ea49cf16-2390-4c43-a4f8-00fad9aafd2e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.432095] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-ea49cf16-2390-4c43-a4f8-00fad9aafd2e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.432293] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea49cf16-2390-4c43-a4f8-00fad9aafd2e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.625860] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.626212] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.626368] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.626665] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.626856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.627162] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.627351] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.627467] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.627688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.628491] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.628491] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a is going to be updated. [ 1127.651995] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.652245] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.652245] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.652446] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.652588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.661126] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: IN_PROGRESS for 2s [ 1127.938877] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.939282] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.939487] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.939765] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.939922] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.940103] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port ea49cf16-2390-4c43-a4f8-00fad9aafd2e not found, creating... [ 1127.940412] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.941117] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.941117] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.941117] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.941316] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.941692] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.941920] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.942101] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.942378] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.942571] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.942760] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: ea49cf16-2390-4c43-a4f8-00fad9aafd2e is going to be created. [ 1127.962724] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.962965] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.963114] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.963399] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.963666] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.963912] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-ea49cf16-2390-4c43-a4f8-00fad9aafd2e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.607466] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1128.607957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.696804] env[69559]: INFO networking_nsxv3.common.synchronization [req-e4c6c1b2-b796-4363-9529-613a6574f360 req-46237163-b6a9-49f0-b93d-f222b6b6fe89 service nova] Enqueued Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_rules [ 1128.697013] env[69559]: INFO networking_nsxv3.common.synchronization [req-e4c6c1b2-b796-4363-9529-613a6574f360 req-46237163-b6a9-49f0-b93d-f222b6b6fe89 service nova] Enqueued Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1128.697175] env[69559]: INFO networking_nsxv3.common.synchronization [req-e4c6c1b2-b796-4363-9529-613a6574f360 req-46237163-b6a9-49f0-b93d-f222b6b6fe89 service nova] Enqueued Resource ID: ea49cf16-2390-4c43-a4f8-00fad9aafd2e with Priority: HIGHEST for action port [ 1128.697885] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_rules [ 1128.698071] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1128.698194] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea49cf16-2390-4c43-a4f8-00fad9aafd2e with Priority: HIGHEST for action port [ 1128.698544] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.698693] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.698786] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.699012] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.699134] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.699997] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.700141] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.700325] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea49cf16-2390-4c43-a4f8-00fad9aafd2e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.700424] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea49cf16-2390-4c43-a4f8-00fad9aafd2e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.700542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea49cf16-2390-4c43-a4f8-00fad9aafd2e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.700637] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea49cf16-2390-4c43-a4f8-00fad9aafd2e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.700765] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea49cf16-2390-4c43-a4f8-00fad9aafd2e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.845349] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.845349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.852640] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 in Status: SUCCESS [ 1128.852640] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.852640] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.852640] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.852986] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.852986] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.852986] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.853193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.853193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.853300] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.295378] env[69559]: INFO networking_nsxv3.common.synchronization [req-e4c6c1b2-b796-4363-9529-613a6574f360 req-20889453-c7fd-4a47-9914-2b5d39421bf2 tempest-MultipleCreateTestJSON-687420967 tempest-MultipleCreateTestJSON-687420967-project-member] Enqueued Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1129.295378] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1129.295378] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.295378] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.347834] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea49cf16-2390-4c43-a4f8-00fad9aafd2e with status ACTIVE [ 1129.347834] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.347834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.347834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.347834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.347834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.347834] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.347834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.347834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.347834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.347834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.347834] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.347834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.347834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.347834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.347834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.347834] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea49cf16-2390-4c43-a4f8-00fad9aafd2e is going to be updated. [ 1129.355290] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.374646] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.374646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.374646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.374646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.374646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.374646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea49cf16-2390-4c43-a4f8-00fad9aafd2e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.478729] env[69559]: INFO networking_nsxv3.common.synchronization [req-65d08e25-c661-4b4f-8294-0b95435f422f req-59a20ab8-2e8b-4cf5-8a63-18aa688546b2 tempest-ImagesOneServerNegativeTestJSON-1590344667 tempest-ImagesOneServerNegativeTestJSON-1590344667-project-member] Enqueued Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_members [ 1129.478990] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGHEST for action security_group_members [ 1129.479312] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.479464] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.479506] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.479682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.479836] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.479907] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.479970] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.480475] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.480475] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.480475] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.640332] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-441 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.640648] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-441" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.640648] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-441" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.640942] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-441" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.641196] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.641419] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.641543] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.641753] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.641917] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.642191] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1129.642279] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1129.642397] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1129.642518] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1129.642634] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1129.642744] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1129.643404] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1129.660564] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1129.660724] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1129.660866] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1129.661049] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-441" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.661375] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-34ef13a5-d0a4-4d93-930a-712258a6ac4f taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.661547] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-34ef13a5-d0a4-4d93-930a-712258a6ac4f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.661670] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-34ef13a5-d0a4-4d93-930a-712258a6ac4f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.661965] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-34ef13a5-d0a4-4d93-930a-712258a6ac4f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.662120] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34ef13a5-d0a4-4d93-930a-712258a6ac4f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.670322] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: SUCCESS [ 1129.670322] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a deletion is rescheduled due to dependency. [ 1129.670442] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.670537] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.670668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.670820] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.670923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.670986] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.671140] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.671257] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.671307] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.858106] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.988788] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.988788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.988788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.989074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.989074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.989241] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.989334] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.989370] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.989526] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.989605] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.989691] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b4e023e-3f17-4641-b235-16fa1645d85a is going to be updated. [ 1130.014026] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.014026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.014026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.014253] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.014453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.023257] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b4e023e-3f17-4641-b235-16fa1645d85a in Status: IN_PROGRESS for 2s [ 1130.165523] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.165817] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.165968] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.166327] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.166510] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.166672] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 34ef13a5-d0a4-4d93-930a-712258a6ac4f not found, creating... [ 1130.166999] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.167362] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.167362] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.167623] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.167804] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.168159] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.168360] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.168515] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.168770] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.168936] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.169131] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 34ef13a5-d0a4-4d93-930a-712258a6ac4f is going to be created. [ 1130.172815] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.210546] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.210546] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.210546] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.210546] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.210546] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.210546] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-34ef13a5-d0a4-4d93-930a-712258a6ac4f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.359853] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.360043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.360121] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.360371] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.360464] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.360570] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 is going to be updated. [ 1130.417807] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.417992] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.418043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.418251] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.418447] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.428313] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 in Status: IN_PROGRESS for 2s [ 1130.676492] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.177683] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.177849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.177920] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.178162] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.178255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.178422] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a is going to be updated. [ 1131.229883] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.230060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.230134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.230342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.230485] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.238933] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: IN_PROGRESS for 2s [ 1131.516085] env[69559]: INFO networking_nsxv3.common.synchronization [req-e4c6c1b2-b796-4363-9529-613a6574f360 req-f0b8ce7b-b293-43b5-b47e-6aacede0f852 service nova] Enqueued Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_rules [ 1131.516206] env[69559]: INFO networking_nsxv3.common.synchronization [req-e4c6c1b2-b796-4363-9529-613a6574f360 req-f0b8ce7b-b293-43b5-b47e-6aacede0f852 service nova] Enqueued Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1131.516359] env[69559]: INFO networking_nsxv3.common.synchronization [req-e4c6c1b2-b796-4363-9529-613a6574f360 req-f0b8ce7b-b293-43b5-b47e-6aacede0f852 service nova] Enqueued Resource ID: 34ef13a5-d0a4-4d93-930a-712258a6ac4f with Priority: HIGHEST for action port [ 1131.516590] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_rules [ 1131.516719] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1131.516813] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34ef13a5-d0a4-4d93-930a-712258a6ac4f with Priority: HIGHEST for action port [ 1131.517375] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.517504] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.517718] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.517805] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.517976] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-34ef13a5-d0a4-4d93-930a-712258a6ac4f taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.518095] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34ef13a5-d0a4-4d93-930a-712258a6ac4f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.518159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34ef13a5-d0a4-4d93-930a-712258a6ac4f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.518354] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34ef13a5-d0a4-4d93-930a-712258a6ac4f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.518448] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34ef13a5-d0a4-4d93-930a-712258a6ac4f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.021169] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34ef13a5-d0a4-4d93-930a-712258a6ac4f with status ACTIVE [ 1132.021635] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.021635] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.021751] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.022089] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.022243] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.022559] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.022768] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.022833] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.023120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.023260] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.023586] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.023741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.023836] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.024096] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.024234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.024386] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34ef13a5-d0a4-4d93-930a-712258a6ac4f is going to be updated. [ 1132.039592] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b4e023e-3f17-4641-b235-16fa1645d85a in Status: SUCCESS [ 1132.039792] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b4e023e-3f17-4641-b235-16fa1645d85a deletion is rescheduled due to dependency. [ 1132.039953] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.047464] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.047655] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.047824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.048166] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.048268] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.048360] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34ef13a5-d0a4-4d93-930a-712258a6ac4f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.437873] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 in Status: SUCCESS [ 1132.438124] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.438294] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.438529] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.438729] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.438844] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.438899] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.439066] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.439176] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.439347] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.439347] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.942063] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.251236] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: SUCCESS [ 1133.251702] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.251814] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.252073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.252282] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.252417] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.252477] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.252649] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.252726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.252815] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.252915] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.254032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.254234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.254570] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.254570] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.254720] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.254781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.254829] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.254924] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.444729] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7: rpc.has_security_group_logging(os_id): False [ 1133.462600] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.462840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.462961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.463301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.463455] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.463856] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.464027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.464128] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.464374] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.464548] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.464650] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 is going to be updated. [ 1133.520663] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.520867] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.520957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.521158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.521357] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.533212] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 in Status: IN_PROGRESS for 2s [ 1133.757035] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.757176] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.758560] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.261035] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.763560] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.763757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.763798] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.764033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.764161] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.764229] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a is going to be updated. [ 1134.791921] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.792122] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.792167] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.792606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.792606] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.801721] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: IN_PROGRESS for 2s [ 1135.548875] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 in Status: SUCCESS [ 1135.548875] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.765969] env[69559]: INFO networking_nsxv3.common.synchronization [None req-851318d8-1b84-47ed-9300-31baff7852b2 tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 1135.766258] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 1135.766821] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.767603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.767603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.767603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.767603] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.767898] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.767898] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.767965] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.768040] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.768168] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.270479] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.270728] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.270817] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.271217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.271452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.271699] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.271851] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.271985] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.272117] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.272180] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.272250] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19282542-923d-4b29-8ce7-e30953449122 is going to be updated. [ 1136.297240] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.297440] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.297509] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.297681] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.297829] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.307250] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: IN_PROGRESS for 2s [ 1136.811039] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: SUCCESS [ 1136.811551] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.811901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.812161] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.812379] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.812522] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.812594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.812769] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.812876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.812986] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.315321] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.475568] env[69559]: INFO networking_nsxv3.common.synchronization [req-f519c68f-1210-41be-bddf-5758f15397f7 req-8a83b450-b077-411f-836b-caa5a01b1e31 tempest-AttachVolumeNegativeTest-1400300488 tempest-AttachVolumeNegativeTest-1400300488-project-member] Enqueued Resource ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 with Priority: HIGHEST for action security_group_members [ 1137.476226] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 with Priority: HIGHEST for action security_group_members [ 1137.476561] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3283394-46a2-4c04-8d8d-61fd36d02b80 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.476680] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.476744] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.476945] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.477109] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.477203] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.477261] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.477401] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.477485] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.477571] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3283394-46a2-4c04-8d8d-61fd36d02b80',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.818125] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.979898] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.980158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.980158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.980351] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.980482] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.980638] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.980730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.980790] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.980988] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.981069] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.981159] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 is going to be updated. [ 1138.007590] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.007730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.007793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.007984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.008129] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.016997] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 in Status: IN_PROGRESS for 2s [ 1138.316730] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: SUCCESS [ 1138.317506] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19282542-923d-4b29-8ce7-e30953449122 deletion is rescheduled due to dependency. [ 1138.317506] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.321100] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.321556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.321556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.321556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.321679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.321718] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a is going to be updated. [ 1138.348107] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.348240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.348240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.348397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.348531] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.358364] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: IN_PROGRESS for 2s [ 1138.404906] env[69559]: INFO networking_nsxv3.common.synchronization [req-c04c08c2-98d9-4de2-bb8e-4a1caeea6d62 req-23ae9c31-2837-4a6a-bc2a-febd0d0a4644 tempest-ServersTestJSON-514909010 tempest-ServersTestJSON-514909010-project-member] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1138.405275] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1138.405972] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.406118] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.406187] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.406433] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.406592] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.406730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.406822] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.406982] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.407078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.407171] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.695403] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-640 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.695618] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.695780] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.696106] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.696560] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.696560] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.696703] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.696920] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.697107] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.697327] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1138.697469] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1138.697634] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1138.697769] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1138.697902] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1138.698029] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1138.698194] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1138.722216] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1138.722216] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1138.722216] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1138.722216] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.722216] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-31df6780-e731-4335-a26f-6b2fc32a1afc taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.722216] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-31df6780-e731-4335-a26f-6b2fc32a1afc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.722216] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-31df6780-e731-4335-a26f-6b2fc32a1afc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.722216] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-31df6780-e731-4335-a26f-6b2fc32a1afc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.722216] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31df6780-e731-4335-a26f-6b2fc32a1afc',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.909796] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.227786] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.227786] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.227786] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.227786] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.227786] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.227786] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 31df6780-e731-4335-a26f-6b2fc32a1afc not found, creating... [ 1139.227786] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.227786] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.227786] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.227786] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.227786] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.228587] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.228587] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.228587] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.228587] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.228824] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.228824] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 31df6780-e731-4335-a26f-6b2fc32a1afc is going to be created. [ 1139.249464] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.249687] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.249821] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.250106] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.250652] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.250652] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-31df6780-e731-4335-a26f-6b2fc32a1afc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.390418] env[69559]: INFO networking_nsxv3.common.synchronization [req-6db4f384-e329-4e8a-9784-dc8828539321 req-36ce5ce8-6678-4001-bb39-efe46802c147 tempest-DeleteServersTestJSON-1423597435 tempest-DeleteServersTestJSON-1423597435-project-member] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 1139.394404] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGHEST for action security_group_members [ 1139.395294] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.395294] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.395294] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.395518] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.395674] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.395776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.395838] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.395984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.399590] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.399702] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.412424] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.902763] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.902931] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.902974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.903214] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.903286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.903480] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.903577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.903658] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.903803] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.903877] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.903962] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be updated. [ 1139.917083] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.917411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.917411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.917504] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.917540] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.917621] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1139.937370] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.937512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.937583] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.937832] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.937977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.951611] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: IN_PROGRESS for 2s [ 1139.952689] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.953158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.953158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.953158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.953253] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.955827] env[69559]: INFO networking_nsxv3.common.synchronization [req-c04c08c2-98d9-4de2-bb8e-4a1caeea6d62 req-b482e1b0-5db2-4ba2-905c-dfde15b86b3b service nova] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_rules [ 1139.956009] env[69559]: INFO networking_nsxv3.common.synchronization [req-c04c08c2-98d9-4de2-bb8e-4a1caeea6d62 req-b482e1b0-5db2-4ba2-905c-dfde15b86b3b service nova] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1139.956163] env[69559]: INFO networking_nsxv3.common.synchronization [req-c04c08c2-98d9-4de2-bb8e-4a1caeea6d62 req-b482e1b0-5db2-4ba2-905c-dfde15b86b3b service nova] Enqueued Resource ID: 31df6780-e731-4335-a26f-6b2fc32a1afc with Priority: HIGHEST for action port [ 1139.956623] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_rules [ 1139.956779] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1139.956840] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31df6780-e731-4335-a26f-6b2fc32a1afc with Priority: HIGHEST for action port [ 1139.957104] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.957213] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.957276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.957441] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.957520] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.959251] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.959251] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.959251] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-31df6780-e731-4335-a26f-6b2fc32a1afc taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.959251] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31df6780-e731-4335-a26f-6b2fc32a1afc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.959251] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31df6780-e731-4335-a26f-6b2fc32a1afc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.959251] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31df6780-e731-4335-a26f-6b2fc32a1afc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.959251] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31df6780-e731-4335-a26f-6b2fc32a1afc',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.961965] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1140.025679] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 in Status: SUCCESS [ 1140.025863] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 deletion is rescheduled due to dependency. [ 1140.025971] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.035542] env[69559]: INFO networking_nsxv3.common.synchronization [req-18b0d3aa-595d-4ba0-97e5-3fa9fb7a9354 req-0558eb5c-75af-451a-827d-e32a97e80e8f tempest-ServerActionsTestOtherA-1414477814 tempest-ServerActionsTestOtherA-1414477814-project-member] Enqueued Resource ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 with Priority: HIGHEST for action security_group_members [ 1140.035796] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 with Priority: HIGHEST for action security_group_members [ 1140.036109] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.036266] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.036368] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.036507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.036657] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.036756] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.036863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.036957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.037083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.037178] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.372022] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: SUCCESS [ 1140.372022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.372022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.372022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.372022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.372022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.372022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.372022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.372022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.372022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.372022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.372022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.372022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.372022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.372022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.372022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.372022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.372022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.372022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.372948] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.373156] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.461932] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.461932] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.461932] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31df6780-e731-4335-a26f-6b2fc32a1afc with status ACTIVE [ 1140.461932] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.461932] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.461932] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.461932] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.461932] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.462449] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.462449] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.462449] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.462449] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.462449] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.462620] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.462725] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.462725] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.462916] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.462916] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.463018] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31df6780-e731-4335-a26f-6b2fc32a1afc is going to be updated. [ 1140.485610] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.485788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.485856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.486030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.486165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.486318] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31df6780-e731-4335-a26f-6b2fc32a1afc" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.539461] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.539619] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.539688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.539935] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.565992] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.566255] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.566373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.566438] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.566623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.566708] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.566796] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 is going to be updated. [ 1140.589942] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.590128] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.590185] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.590346] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.590455] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.606258] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 in Status: IN_PROGRESS for 2s [ 1140.875558] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d52f1e04-af0f-4b37-a85f-0fe71f26399a: rpc.has_security_group_logging(os_id): False [ 1140.891967] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.892133] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.892181] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.892400] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.892493] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.892700] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.892859] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.892859] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.892996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.893075] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.893276] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.893368] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.893427] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.893698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.893698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.893912] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.894018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.894082] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.894219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.894295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.894377] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a is going to be updated. [ 1140.958397] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.958845] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.958845] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.959434] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.959434] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.972602] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: IN_PROGRESS for 2s [ 1141.962503] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 839ae40b-5f13-4259-8e2a-b943b206557d in Status: SUCCESS [ 1141.962826] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d deletion is rescheduled due to dependency. [ 1141.962826] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.970751] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1141.970959] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.971135] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.971369] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.971564] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.971683] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.971750] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.971894] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.971976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.972071] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.474275] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.617023] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 in Status: SUCCESS [ 1142.617023] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 deletion is rescheduled due to dependency. [ 1142.617023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.847113] env[69559]: INFO networking_nsxv3.common.synchronization [None req-9a45a7f5-d316-46ab-b335-dd032061df41 tempest-AttachVolumeNegativeTest-1400300488 tempest-AttachVolumeNegativeTest-1400300488-project-member] Enqueued Resource ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa with Priority: HIGHEST for action security_group_rules [ 1142.847966] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa with Priority: HIGHEST for action security_group_rules [ 1142.848276] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.848478] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.848578] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.848922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.849098] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.961731] env[69559]: INFO networking_nsxv3.common.synchronization [None req-3f868ba1-54a3-4ff0-b300-e8b406cd0b8d tempest-AttachVolumeNegativeTest-1400300488 tempest-AttachVolumeNegativeTest-1400300488-project-member] Enqueued Resource ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa with Priority: HIGHEST for action security_group_rules [ 1142.962575] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa with Priority: HIGHEST for action security_group_rules [ 1142.962848] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.962967] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.975877] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.985374] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: SUCCESS [ 1142.985581] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.985960] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.986179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.986357] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.088335] env[69559]: INFO networking_nsxv3.common.synchronization [req-b86ad80b-3959-4bf5-a225-4d7966e2599f req-93f01745-55b6-45ad-881e-ce00203a08c9 tempest-MultipleCreateTestJSON-687420967 tempest-MultipleCreateTestJSON-687420967-project-member] Enqueued Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1143.089850] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1143.089850] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.089850] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.089850] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.089850] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.089850] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.089850] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.090369] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.090369] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.090369] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.090369] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.290110] env[69559]: INFO networking_nsxv3.common.synchronization [req-505cdb4d-ae70-4391-8240-3300cbe9a1b2 req-9bb92f93-ea3a-49ac-9821-a291592272cf tempest-MultipleCreateTestJSON-687420967 tempest-MultipleCreateTestJSON-687420967-project-member] Enqueued Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1143.290626] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGHEST for action security_group_members [ 1143.290933] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.291053] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.366886] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.367044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.367151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.367325] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.367418] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.367515] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa already deleted. [ 1143.367595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.367732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.367878] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.367958] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.477993] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.478167] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.478269] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.478435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.478525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.478625] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1143.488055] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.488168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.507786] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.507921] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.507987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.508208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.508350] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.516281] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1143.591931] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.887031] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.887031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.887031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.887031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.887031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.887335] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa already deleted. [ 1143.887335] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.093787] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.596661] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.596739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.596822] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.598418] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.598418] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.598418] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a is going to be updated. [ 1144.623444] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.623444] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.623444] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.623444] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.623444] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.631889] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: IN_PROGRESS for 2s [ 1145.527789] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1145.527789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.527789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.527789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.527789] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.527789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.527789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.527789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.527789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.527789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.527789] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.030506] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.030506] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.030506] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.030652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.030784] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.030936] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.031032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.031232] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.031347] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.031468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.031681] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.031785] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.031850] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.031994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.032145] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.032239] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.032300] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.032434] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.032509] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.032589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.032675] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.537033] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebf5f404-8f48-487f-b212-72786dc389e8: rpc.has_security_group_logging(os_id): False [ 1146.553063] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.553249] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.553322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.553540] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.553647] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.553858] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.553951] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.554026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.554181] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.554258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.554454] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.554549] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.554611] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.554796] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.554852] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.554997] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.555101] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.555164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.555300] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.555373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.555483] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1146.614768] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.614992] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.615137] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.615427] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.615600] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.629963] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1146.639068] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: SUCCESS [ 1146.639319] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.639500] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.639702] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.639884] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.640010] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.640108] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.640285] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.640399] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.640517] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.143984] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.143984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.143984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.143984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.144283] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.144327] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.144411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.144483] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.144661] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.144755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.146232] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a is going to be updated. [ 1147.167842] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.167977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.168058] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.168258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.168414] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.176335] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: IN_PROGRESS for 2s [ 1148.292166] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1148.292166] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1148.417309] env[69559]: INFO networking_nsxv3.common.synchronization [None req-bd413166-a938-44d0-8f85-4c2d61a553c5 None None] Enqueued Resource ID: b0669dbd-7d2f-4de8-8743-d2749db76e88 with Priority: HIGHEST for action port [ 1148.417420] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0669dbd-7d2f-4de8-8743-d2749db76e88 with Priority: HIGHEST for action port [ 1148.418390] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0669dbd-7d2f-4de8-8743-d2749db76e88 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.418560] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0669dbd-7d2f-4de8-8743-d2749db76e88" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.418607] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0669dbd-7d2f-4de8-8743-d2749db76e88" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.418846] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0669dbd-7d2f-4de8-8743-d2749db76e88" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.418931] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0669dbd-7d2f-4de8-8743-d2749db76e88',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.647459] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1148.648149] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.925093] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0669dbd-7d2f-4de8-8743-d2749db76e88 [ 1148.925590] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.925590] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.925590] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.925785] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.925849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.925947] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0669dbd-7d2f-4de8-8743-d2749db76e88 already deleted. [ 1148.926036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0669dbd-7d2f-4de8-8743-d2749db76e88" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.186406] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: SUCCESS [ 1149.188409] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a deletion is rescheduled due to dependency. [ 1149.188409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.188409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.188409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.188409] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.188409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.188409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.188409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.188409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.188409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.188409] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.691573] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.691974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.691974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.692904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.692904] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.692904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.692904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.692904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.692904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.692904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.693320] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.693320] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.693320] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.693320] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.693532] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.693532] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.693532] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.693696] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.693696] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.693787] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.693905] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.200068] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d52f1e04-af0f-4b37-a85f-0fe71f26399a: rpc.has_security_group_logging(os_id): False [ 1150.217218] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.217467] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.217505] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.217707] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.217794] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.218026] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.218130] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.218191] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.218334] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.218408] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.218671] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.218753] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.219918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.219918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.219918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.219918] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.219918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.219918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.219918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.219918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.219918] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a is going to be updated. [ 1150.275895] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.276078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.276485] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.276485] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.276674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.289900] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: IN_PROGRESS for 2s [ 1150.622205] env[69559]: INFO networking_nsxv3.common.synchronization [None req-6891d479-0f45-46f1-a18f-c71c522b4a2e None None] Enqueued Resource ID: df7d9808-78cb-4463-bd30-e68c0cd0eaac with Priority: HIGHEST for action port [ 1150.623989] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df7d9808-78cb-4463-bd30-e68c0cd0eaac with Priority: HIGHEST for action port [ 1150.623989] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-df7d9808-78cb-4463-bd30-e68c0cd0eaac taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.623989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df7d9808-78cb-4463-bd30-e68c0cd0eaac" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.623989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df7d9808-78cb-4463-bd30-e68c0cd0eaac" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.623989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df7d9808-78cb-4463-bd30-e68c0cd0eaac" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.623989] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df7d9808-78cb-4463-bd30-e68c0cd0eaac',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.887628] env[69559]: INFO networking_nsxv3.common.synchronization [req-423099fe-08c1-4a81-a609-0cc21dcf1bb9 req-d721c4bc-deb0-4383-8353-cf1dd65d2d29 tempest-ServersTestJSON-514909010 tempest-ServersTestJSON-514909010-project-member] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1150.888150] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1150.888469] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.888621] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.888708] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.888892] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.889670] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.889822] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.889912] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.890067] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.890171] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.890254] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.127367] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df7d9808-78cb-4463-bd30-e68c0cd0eaac [ 1151.127614] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.127750] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.127820] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.128057] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.128153] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.128254] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df7d9808-78cb-4463-bd30-e68c0cd0eaac already deleted. [ 1151.128339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df7d9808-78cb-4463-bd30-e68c0cd0eaac" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.285894] env[69559]: INFO networking_nsxv3.common.synchronization [req-b35d5349-619a-4e97-aba8-88799c3a4d4b req-f713609f-6a80-48f6-8f92-81af6ee9be5c tempest-AttachVolumeNegativeTest-1400300488 tempest-AttachVolumeNegativeTest-1400300488-project-member] Enqueued Resource ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa with Priority: HIGHEST for action security_group_members [ 1151.286670] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa with Priority: HIGHEST for action security_group_members [ 1151.287163] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.287330] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.287438] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.287806] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.288111] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.288286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.288397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.288643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.288793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.288950] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.392843] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.671404] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-979 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.671647] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-979" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.671782] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-979" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.672059] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-979" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.672332] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.672510] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.672638] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.672849] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.673006] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.673223] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1151.673344] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1151.673458] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1151.673574] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1151.673690] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1151.673802] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1151.673939] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1151.692686] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1151.692862] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1151.693009] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1151.693194] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-979" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.693481] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-4e33f8e1-0542-4b05-8790-4227721ebe34 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.693649] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-4e33f8e1-0542-4b05-8790-4227721ebe34" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.693789] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-4e33f8e1-0542-4b05-8790-4227721ebe34" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.694112] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-4e33f8e1-0542-4b05-8790-4227721ebe34" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.694259] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e33f8e1-0542-4b05-8790-4227721ebe34',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.792443] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.792736] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.792837] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.793094] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.793216] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.793448] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.793574] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.793645] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.793833] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.793901] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.793985] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa already deleted. [ 1151.794097] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.895740] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.198118] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.198360] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.198492] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.198785] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.198945] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.199116] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 4e33f8e1-0542-4b05-8790-4227721ebe34 not found, creating... [ 1152.199384] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.199617] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.199745] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.199962] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.200118] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.200409] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.200572] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.200704] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.200909] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.201061] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.201212] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 4e33f8e1-0542-4b05-8790-4227721ebe34 is going to be created. [ 1152.220259] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.220437] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.220591] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.220814] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.221061] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.221285] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-4e33f8e1-0542-4b05-8790-4227721ebe34" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.308956] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a in Status: SUCCESS [ 1152.309380] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.398804] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.399069] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.399069] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.399413] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.399549] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.399621] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1152.427895] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.428124] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.428124] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.428360] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.428441] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.439559] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1152.930114] env[69559]: INFO networking_nsxv3.common.synchronization [req-b35d5349-619a-4e97-aba8-88799c3a4d4b req-8e72fc99-5251-4cbb-ae98-e4ac812f1239 service nova] Enqueued Resource ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa with Priority: HIGHEST for action security_group_rules [ 1152.930425] env[69559]: INFO networking_nsxv3.common.synchronization [req-b35d5349-619a-4e97-aba8-88799c3a4d4b req-8e72fc99-5251-4cbb-ae98-e4ac812f1239 service nova] Enqueued Resource ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa with Priority: HIGHEST for action security_group_members [ 1152.930583] env[69559]: INFO networking_nsxv3.common.synchronization [req-b35d5349-619a-4e97-aba8-88799c3a4d4b req-8e72fc99-5251-4cbb-ae98-e4ac812f1239 service nova] Enqueued Resource ID: 4e33f8e1-0542-4b05-8790-4227721ebe34 with Priority: HIGHEST for action port [ 1152.930666] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa with Priority: HIGHEST for action security_group_rules [ 1152.930790] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa with Priority: HIGHEST for action security_group_members [ 1152.930885] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e33f8e1-0542-4b05-8790-4227721ebe34 with Priority: HIGHEST for action port [ 1152.931419] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.931584] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.931643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.931861] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.931910] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.933238] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.933776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.933882] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.934117] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.934291] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.934412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.934499] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.934671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.934778] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.934891] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.935794] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e33f8e1-0542-4b05-8790-4227721ebe34 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.937589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e33f8e1-0542-4b05-8790-4227721ebe34" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.937669] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e33f8e1-0542-4b05-8790-4227721ebe34" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.937907] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e33f8e1-0542-4b05-8790-4227721ebe34" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.938052] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e33f8e1-0542-4b05-8790-4227721ebe34',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.440119] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.441900] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.441900] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.441900] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e33f8e1-0542-4b05-8790-4227721ebe34 with status ACTIVE [ 1153.441900] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.441900] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.441900] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.442294] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.442294] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.442294] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.442405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.442405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.442551] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.442650] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.442832] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.442923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.442984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.443165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.443240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.443323] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e33f8e1-0542-4b05-8790-4227721ebe34 is going to be updated. [ 1153.463146] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.463281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.463341] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.463481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.463604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.463748] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e33f8e1-0542-4b05-8790-4227721ebe34" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.536259] env[69559]: INFO networking_nsxv3.common.synchronization [req-74819ae7-5975-44a6-bbd2-ec50e1281a1a req-0acebff8-a174-40e6-8563-17ca1f2927ff tempest-ServerActionsTestOtherA-1414477814 tempest-ServerActionsTestOtherA-1414477814-project-member] Enqueued Resource ID: e29c3806-d806-4df2-8a52-0ecf9da87984 with Priority: HIGHEST for action security_group_members [ 1153.536746] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e29c3806-d806-4df2-8a52-0ecf9da87984 with Priority: HIGHEST for action security_group_members [ 1153.537052] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e29c3806-d806-4df2-8a52-0ecf9da87984 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.537185] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.537227] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.537417] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.537879] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.538009] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.538081] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.538242] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.538327] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.538421] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e29c3806-d806-4df2-8a52-0ecf9da87984',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.923815] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-964 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.924014] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.924153] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.924426] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.924764] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.924946] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.925111] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.925360] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.925540] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.925952] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1153.925952] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1153.926071] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1153.926188] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1153.926664] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1153.926664] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1153.926664] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1153.944879] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1153.945173] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1153.945225] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1153.945416] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.945802] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-593470ff-12af-4f24-be4f-697c10a959f5 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.945971] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-593470ff-12af-4f24-be4f-697c10a959f5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.946115] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-593470ff-12af-4f24-be4f-697c10a959f5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.946445] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-593470ff-12af-4f24-be4f-697c10a959f5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.946608] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('593470ff-12af-4f24-be4f-697c10a959f5',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.947480] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.040725] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.040971] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.041090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.041326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.061227] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.061554] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.061679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.061746] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.061981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.062080] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.062182] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e29c3806-d806-4df2-8a52-0ecf9da87984 is going to be updated. [ 1154.086750] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.086750] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.086862] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.086968] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.087156] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.095625] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e29c3806-d806-4df2-8a52-0ecf9da87984 in Status: IN_PROGRESS for 2s [ 1154.448502] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1154.448727] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.449286] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.449502] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.449652] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.449917] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.450078] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.450231] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 593470ff-12af-4f24-be4f-697c10a959f5 not found, creating... [ 1154.450485] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.450650] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.450771] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.450985] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.451138] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.451415] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.451606] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.451737] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.451950] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.452103] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.452313] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 593470ff-12af-4f24-be4f-697c10a959f5 is going to be created. [ 1154.453310] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.453423] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.453493] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.453641] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.453717] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.453801] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa is going to be created. [ 1154.474172] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.474371] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.474521] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.474784] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.475032] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.475253] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-593470ff-12af-4f24-be4f-697c10a959f5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.476494] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.476626] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.476699] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.476855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.476987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.484671] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa in Status: UNINITIALIZED for 2s [ 1155.517665] env[69559]: INFO networking_nsxv3.common.synchronization [req-74819ae7-5975-44a6-bbd2-ec50e1281a1a req-e121023a-184b-4f88-87c4-73bdb4060d03 service nova] Enqueued Resource ID: e29c3806-d806-4df2-8a52-0ecf9da87984 with Priority: HIGHEST for action security_group_rules [ 1155.517944] env[69559]: INFO networking_nsxv3.common.synchronization [req-74819ae7-5975-44a6-bbd2-ec50e1281a1a req-e121023a-184b-4f88-87c4-73bdb4060d03 service nova] Enqueued Resource ID: e29c3806-d806-4df2-8a52-0ecf9da87984 with Priority: HIGHEST for action security_group_members [ 1155.518057] env[69559]: INFO networking_nsxv3.common.synchronization [req-74819ae7-5975-44a6-bbd2-ec50e1281a1a req-e121023a-184b-4f88-87c4-73bdb4060d03 service nova] Enqueued Resource ID: 593470ff-12af-4f24-be4f-697c10a959f5 with Priority: HIGHEST for action port [ 1155.518252] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e29c3806-d806-4df2-8a52-0ecf9da87984 with Priority: HIGHEST for action security_group_rules [ 1155.518377] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e29c3806-d806-4df2-8a52-0ecf9da87984 with Priority: HIGHEST for action security_group_members [ 1155.518472] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593470ff-12af-4f24-be4f-697c10a959f5 with Priority: HIGHEST for action port [ 1155.519039] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e29c3806-d806-4df2-8a52-0ecf9da87984 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.519164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.519233] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.519463] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.519561] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e29c3806-d806-4df2-8a52-0ecf9da87984',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.520743] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e29c3806-d806-4df2-8a52-0ecf9da87984 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.520845] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.521056] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-593470ff-12af-4f24-be4f-697c10a959f5 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.521167] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-593470ff-12af-4f24-be4f-697c10a959f5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.521226] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-593470ff-12af-4f24-be4f-697c10a959f5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.521376] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-593470ff-12af-4f24-be4f-697c10a959f5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.521441] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('593470ff-12af-4f24-be4f-697c10a959f5',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.023465] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e29c3806-d806-4df2-8a52-0ecf9da87984 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.023764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.023976] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 593470ff-12af-4f24-be4f-697c10a959f5 with status ACTIVE [ 1156.024170] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.024300] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.024395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.024585] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.024698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.024854] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.024952] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.025030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.025188] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.025267] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.025463] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.025981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.025981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.025981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.025981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.025981] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 593470ff-12af-4f24-be4f-697c10a959f5 is going to be updated. [ 1156.048126] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.048126] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.048126] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.048126] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.048351] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.048452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-593470ff-12af-4f24-be4f-697c10a959f5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.153020] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e29c3806-d806-4df2-8a52-0ecf9da87984 in Status: SUCCESS [ 1156.153020] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e29c3806-d806-4df2-8a52-0ecf9da87984 deletion is rescheduled due to dependency. [ 1156.153498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.153782] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.154610] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.154917] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.155095] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.155177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.156544] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.156544] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.156544] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e29c3806-d806-4df2-8a52-0ecf9da87984',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.494323] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa in Status: SUCCESS [ 1156.494537] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.494696] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.494953] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.495125] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.495349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.495450] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.495617] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.495705] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.495795] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.495887] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.658210] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e29c3806-d806-4df2-8a52-0ecf9da87984',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.001330] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.160268] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e29c3806-d806-4df2-8a52-0ecf9da87984',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.503755] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa: rpc.has_security_group_logging(os_id): False [ 1157.520876] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.521153] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.521284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.521897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.521897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.522192] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.522292] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.522353] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.522514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.522656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.522711] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa is going to be created. [ 1157.582966] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.583183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.583259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.583553] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.583810] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.594464] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa in Status: IN_PROGRESS for 2s [ 1157.663031] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.663435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.663435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.663435] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.663558] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.663658] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e29c3806-d806-4df2-8a52-0ecf9da87984 is going to be updated. [ 1157.700727] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.700940] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.701052] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.701304] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.701627] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.710226] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e29c3806-d806-4df2-8a52-0ecf9da87984 in Status: IN_PROGRESS for 2s [ 1158.191757] env[69559]: INFO networking_nsxv3.common.synchronization [req-f1df73fd-a729-445f-adb3-b1a31a0b6d66 req-43b7ea92-a3b4-4760-bd97-f4bb8136c900 tempest-ServerDiskConfigTestJSON-722175017 tempest-ServerDiskConfigTestJSON-722175017-project-member] Enqueued Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1158.196020] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1158.196020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.196020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.196020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.196020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.196020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.196020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.196020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.196020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.196020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.196020] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.381252] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.381496] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.381671] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.382014] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.382255] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.382436] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.382603] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.382864] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.383048] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.383281] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1158.383414] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1158.383541] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1158.383663] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1158.383790] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1158.383905] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1158.384066] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1158.403218] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1158.403549] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1158.403723] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1158.403778] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.404186] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-d5d9c354-c261-492e-9191-df2862cd2b49 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.404382] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-d5d9c354-c261-492e-9191-df2862cd2b49" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.404512] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-d5d9c354-c261-492e-9191-df2862cd2b49" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.404852] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-d5d9c354-c261-492e-9191-df2862cd2b49" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.405122] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5d9c354-c261-492e-9191-df2862cd2b49',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.502113] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.502329] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-134" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.502465] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-134" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.502809] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-134" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.503084] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.503268] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.503412] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.503665] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.503824] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.504045] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1158.504163] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1158.504276] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1158.504387] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1158.504500] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1158.504609] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1158.504746] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1158.524504] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1158.525746] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1158.525746] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1158.525746] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-134" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.525746] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-ddcbcec4-5354-4034-a2e0-9076aa00037e taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.525746] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-ddcbcec4-5354-4034-a2e0-9076aa00037e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.525746] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-ddcbcec4-5354-4034-a2e0-9076aa00037e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.526416] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-ddcbcec4-5354-4034-a2e0-9076aa00037e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.526416] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddcbcec4-5354-4034-a2e0-9076aa00037e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.698950] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.699368] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.699368] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.699601] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.699734] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.699996] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.700168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.700261] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.700481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.700602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.700724] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba already deleted. [ 1158.700848] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.908227] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.908585] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.908585] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.908901] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.909077] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.909241] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port d5d9c354-c261-492e-9191-df2862cd2b49 not found, creating... [ 1158.909517] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.909684] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.909862] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.910051] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.910210] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.910494] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.910690] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.910836] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.911045] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.911188] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.911331] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: d5d9c354-c261-492e-9191-df2862cd2b49 is going to be created. [ 1158.935764] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.935764] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.936043] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.936125] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.936368] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.936604] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-d5d9c354-c261-492e-9191-df2862cd2b49" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.030564] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.030661] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.030858] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.031214] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.031383] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.031441] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port ddcbcec4-5354-4034-a2e0-9076aa00037e not found, creating... [ 1159.031854] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.032100] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.032277] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.032607] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.032782] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.033112] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.033265] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.033387] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.033636] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.033828] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.034076] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: ddcbcec4-5354-4034-a2e0-9076aa00037e is going to be created. [ 1159.061642] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.061903] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.062039] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.062342] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.062573] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.062799] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-ddcbcec4-5354-4034-a2e0-9076aa00037e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.607999] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa in Status: SUCCESS [ 1159.607999] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.637329] env[69559]: INFO networking_nsxv3.common.synchronization [req-b8300a6b-e904-4187-9d2a-8a49b8125878 req-3f541298-f79c-4368-9643-cf0722f33945 service nova] Enqueued Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_rules [ 1159.637329] env[69559]: INFO networking_nsxv3.common.synchronization [req-b8300a6b-e904-4187-9d2a-8a49b8125878 req-3f541298-f79c-4368-9643-cf0722f33945 service nova] Enqueued Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 1159.637329] env[69559]: INFO networking_nsxv3.common.synchronization [req-b8300a6b-e904-4187-9d2a-8a49b8125878 req-3f541298-f79c-4368-9643-cf0722f33945 service nova] Enqueued Resource ID: d5d9c354-c261-492e-9191-df2862cd2b49 with Priority: HIGHEST for action port [ 1159.637329] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_rules [ 1159.637329] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 1159.637329] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5d9c354-c261-492e-9191-df2862cd2b49 with Priority: HIGHEST for action port [ 1159.637329] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.637329] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.637329] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.637884] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.638080] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.639557] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.639802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.639971] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.640278] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.640539] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.641024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.641024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.641024] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.642030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.642030] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.642823] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5d9c354-c261-492e-9191-df2862cd2b49 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.643150] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5d9c354-c261-492e-9191-df2862cd2b49" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.643322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5d9c354-c261-492e-9191-df2862cd2b49" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.643566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5d9c354-c261-492e-9191-df2862cd2b49" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.645025] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5d9c354-c261-492e-9191-df2862cd2b49',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.722033] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e29c3806-d806-4df2-8a52-0ecf9da87984 in Status: SUCCESS [ 1159.722033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.722033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.722033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.722033] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.722033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.722033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.722033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.722033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.722033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.722033] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e29c3806-d806-4df2-8a52-0ecf9da87984',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.889318] env[69559]: INFO networking_nsxv3.common.synchronization [req-f1df73fd-a729-445f-adb3-b1a31a0b6d66 req-3a040367-4bcf-482c-b4d1-8dbbb087d88a service nova] Enqueued Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_rules [ 1159.889562] env[69559]: INFO networking_nsxv3.common.synchronization [req-f1df73fd-a729-445f-adb3-b1a31a0b6d66 req-3a040367-4bcf-482c-b4d1-8dbbb087d88a service nova] Enqueued Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1159.889743] env[69559]: INFO networking_nsxv3.common.synchronization [req-f1df73fd-a729-445f-adb3-b1a31a0b6d66 req-3a040367-4bcf-482c-b4d1-8dbbb087d88a service nova] Enqueued Resource ID: ddcbcec4-5354-4034-a2e0-9076aa00037e with Priority: HIGHEST for action port [ 1159.890301] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_rules [ 1159.890441] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1159.890553] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddcbcec4-5354-4034-a2e0-9076aa00037e with Priority: HIGHEST for action port [ 1159.890853] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.891364] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.891364] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.891364] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.891478] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.892341] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.892456] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.892540] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.892715] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.892867] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.892977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.893051] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.893194] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.893279] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.893368] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.894141] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddcbcec4-5354-4034-a2e0-9076aa00037e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.894221] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddcbcec4-5354-4034-a2e0-9076aa00037e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.894301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddcbcec4-5354-4034-a2e0-9076aa00037e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.894468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddcbcec4-5354-4034-a2e0-9076aa00037e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.894560] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddcbcec4-5354-4034-a2e0-9076aa00037e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.145544] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.146910] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.146910] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.147408] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5d9c354-c261-492e-9191-df2862cd2b49 with status ACTIVE [ 1160.147656] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.147808] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.147992] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.148282] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.148458] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.148650] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.148811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.148925] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.149208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.149301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.149601] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.149722] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.149820] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.149976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.150080] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.150172] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5d9c354-c261-492e-9191-df2862cd2b49 is going to be updated. [ 1160.174077] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.174297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.174399] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.174591] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.174735] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.174891] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5d9c354-c261-492e-9191-df2862cd2b49" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.223826] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e29c3806-d806-4df2-8a52-0ecf9da87984 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.224102] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.224168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.224391] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.224621] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.224755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.224806] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.225079] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.225079] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.225203] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.225471] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e29c3806-d806-4df2-8a52-0ecf9da87984 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.225593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.225666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.225840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.226052] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.226173] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.226258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.226428] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.226537] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.226637] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.226754] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e29c3806-d806-4df2-8a52-0ecf9da87984',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.396920] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.396920] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.397126] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.398044] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ddcbcec4-5354-4034-a2e0-9076aa00037e with status ACTIVE [ 1160.398191] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.398310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.398368] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.398579] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.398880] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.398880] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.399018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.399018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.399119] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.399211] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.399425] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.399621] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.399692] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.399831] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.399923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.400026] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ddcbcec4-5354-4034-a2e0-9076aa00037e is going to be updated. [ 1160.420640] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.420826] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.420920] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.421245] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.421417] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.421623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddcbcec4-5354-4034-a2e0-9076aa00037e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.652417] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.728786] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e29c3806-d806-4df2-8a52-0ecf9da87984: rpc.has_security_group_logging(os_id): False [ 1160.746685] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.746854] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.746929] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.747157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.747249] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.747470] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.747569] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.747633] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.747777] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.747854] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.748077] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.748194] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.748240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.748354] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.748425] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.748600] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.748694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.748755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.749100] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.749183] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.749272] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e29c3806-d806-4df2-8a52-0ecf9da87984 is going to be updated. [ 1160.807638] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.807791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.807848] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.808072] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.808259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.823662] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e29c3806-d806-4df2-8a52-0ecf9da87984 in Status: IN_PROGRESS for 2s [ 1160.902406] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.154829] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.155199] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.155601] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.155914] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.156070] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.156877] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19282542-923d-4b29-8ce7-e30953449122 is going to be updated. [ 1161.187332] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.187545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.187545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.187834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.187930] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.196541] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: IN_PROGRESS for 2s [ 1161.408706] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.408706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.408706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.408706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.408706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.408706] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba is going to be created. [ 1161.430718] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.430718] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.430718] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.430718] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.431045] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.441678] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: UNINITIALIZED for 2s [ 1162.837412] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e29c3806-d806-4df2-8a52-0ecf9da87984 in Status: SUCCESS [ 1162.837804] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.211241] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: SUCCESS [ 1163.211489] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.211736] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.211985] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.212296] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.212464] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.212536] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.212721] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.212805] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.212905] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.213028] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.461906] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: SUCCESS [ 1163.461906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.461906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.461906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.461906] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.461906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.461906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.461906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.461906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.461906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.461906] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.550396] env[69559]: INFO networking_nsxv3.common.synchronization [req-3dd31df3-dc48-4d8d-a5e0-e9f48c93bd18 req-fd3a6264-3ef7-43f8-9eb2-544c01a8f6ed tempest-ServerActionsTestOtherA-1414477814 tempest-ServerActionsTestOtherA-1414477814-project-member] Enqueued Resource ID: e29c3806-d806-4df2-8a52-0ecf9da87984 with Priority: HIGHEST for action security_group_members [ 1163.550396] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e29c3806-d806-4df2-8a52-0ecf9da87984 with Priority: HIGHEST for action security_group_members [ 1163.551081] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-e29c3806-d806-4df2-8a52-0ecf9da87984 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.551081] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.551081] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.552410] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.552410] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.552410] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.552410] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.552410] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.552410] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.552410] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e29c3806-d806-4df2-8a52-0ecf9da87984',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.593280] env[69559]: INFO networking_nsxv3.common.synchronization [req-3dd31df3-dc48-4d8d-a5e0-e9f48c93bd18 req-fd3a6264-3ef7-43f8-9eb2-544c01a8f6ed tempest-ServerActionsTestOtherA-1414477814 tempest-ServerActionsTestOtherA-1414477814-project-member] Enqueued Resource ID: 593470ff-12af-4f24-be4f-697c10a959f5 with Priority: HIGHEST for action port [ 1163.593782] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593470ff-12af-4f24-be4f-697c10a959f5 with Priority: HIGHEST for action port [ 1163.594362] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-593470ff-12af-4f24-be4f-697c10a959f5 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.594498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-593470ff-12af-4f24-be4f-697c10a959f5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.594564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-593470ff-12af-4f24-be4f-697c10a959f5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.594769] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-593470ff-12af-4f24-be4f-697c10a959f5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.594849] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('593470ff-12af-4f24-be4f-697c10a959f5',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.717019] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.717019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.717019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.717019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.717019] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.717019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.717019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.717019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.717019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.717019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.717019] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.717019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.717019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.717019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.717019] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.717019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.717645] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.717645] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.717645] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.717758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.717864] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.964062] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.964407] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.964407] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.964630] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.964679] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.964779] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.964834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.964968] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.965082] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.965216] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.965458] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.965542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.965598] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.965700] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.966310] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.966310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.966310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.966310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.966310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.966310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.966571] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.054079] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.054166] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.054205] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.055326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.055326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.055326] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.055326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.055326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.055326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.055326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.055326] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e29c3806-d806-4df2-8a52-0ecf9da87984 is going to be updated. [ 1164.079705] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.079876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.079948] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.080169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.080305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.088533] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e29c3806-d806-4df2-8a52-0ecf9da87984 in Status: IN_PROGRESS for 2s [ 1164.096942] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 593470ff-12af-4f24-be4f-697c10a959f5 with status ACTIVE [ 1164.097166] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.097296] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.097359] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.097545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.097635] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.097808] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.098131] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.098131] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.098131] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.098217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.098388] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.098453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.098522] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.098647] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.098705] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.098793] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 593470ff-12af-4f24-be4f-697c10a959f5 is going to be updated. [ 1164.119168] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.119337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.119485] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.119682] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.119820] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.119982] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-593470ff-12af-4f24-be4f-697c10a959f5" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.221070] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19282542-923d-4b29-8ce7-e30953449122: rpc.has_security_group_logging(os_id): False [ 1164.240905] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.241062] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.241137] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.241352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.241442] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.241704] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.241872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.241872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.242020] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.242106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.242320] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.242413] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.242472] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.242622] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.242705] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.242899] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.243025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.243083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.243200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.243269] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.243353] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19282542-923d-4b29-8ce7-e30953449122 is going to be updated. [ 1164.350851] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.351042] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.351105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.351337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.351492] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.383827] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: IN_PROGRESS for 2s [ 1164.468663] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28bbda40-40d2-4987-875c-100d45eebdba: rpc.has_security_group_logging(os_id): False [ 1164.496205] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.496345] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.496413] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.496632] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.496753] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.496994] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.497105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.497172] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.497327] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.497405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.497582] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.497678] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.497740] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.497878] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.497955] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.498153] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.498249] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.498313] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.498451] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.498527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.498613] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28bbda40-40d2-4987-875c-100d45eebdba is going to be created. [ 1164.559655] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.559859] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.559924] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.560231] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.560434] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.587172] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: IN_PROGRESS for 2s [ 1165.184027] env[69559]: INFO networking_nsxv3.common.synchronization [req-b0e1c4de-a55d-4925-91fc-9dd1a6cb4694 req-6feb1ba5-201f-4652-904e-082daa1e3b4f tempest-ServersTestJSON-514909010 tempest-ServersTestJSON-514909010-project-member] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1165.184027] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1165.184353] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.184474] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.184543] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.184745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.185024] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.185134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.185187] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.185766] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.185766] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.185766] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.687942] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.899021] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-640 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.899247] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.899379] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.899662] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.899943] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.900406] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.900555] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.900816] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.900954] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.901199] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1165.901356] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1165.901510] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1165.901673] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1165.901805] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1165.902454] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1165.903151] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1165.921689] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1165.921877] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1165.922041] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1165.924387] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-640" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.924387] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-87e13dd6-6cbd-4016-8ae4-1e0300e3e063 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.924387] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-87e13dd6-6cbd-4016-8ae4-1e0300e3e063" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.924387] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-87e13dd6-6cbd-4016-8ae4-1e0300e3e063" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.924387] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-87e13dd6-6cbd-4016-8ae4-1e0300e3e063" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.924387] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87e13dd6-6cbd-4016-8ae4-1e0300e3e063',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.097897] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e29c3806-d806-4df2-8a52-0ecf9da87984 in Status: SUCCESS [ 1166.098110] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e29c3806-d806-4df2-8a52-0ecf9da87984 deletion is rescheduled due to dependency. [ 1166.098230] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.190398] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.397805] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: SUCCESS [ 1166.398026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.427222] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.427449] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.427582] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.427888] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.428069] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.428235] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 87e13dd6-6cbd-4016-8ae4-1e0300e3e063 not found, creating... [ 1166.428503] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.428703] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.428871] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.429184] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.429364] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.429665] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.429833] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.429955] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.430191] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.430332] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.430476] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 87e13dd6-6cbd-4016-8ae4-1e0300e3e063 is going to be created. [ 1166.451972] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.452192] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.452323] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.452570] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.452896] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.453134] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-87e13dd6-6cbd-4016-8ae4-1e0300e3e063" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.601383] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: SUCCESS [ 1166.601704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.692640] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.692845] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.692912] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.693167] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.693260] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.693365] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1166.720015] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.720169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.720224] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.720395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.720565] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.728325] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1167.246185] env[69559]: INFO networking_nsxv3.common.synchronization [req-b0e1c4de-a55d-4925-91fc-9dd1a6cb4694 req-946c7f01-a5f1-44e1-94a7-18dd619f7b64 service nova] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_rules [ 1167.246452] env[69559]: INFO networking_nsxv3.common.synchronization [req-b0e1c4de-a55d-4925-91fc-9dd1a6cb4694 req-946c7f01-a5f1-44e1-94a7-18dd619f7b64 service nova] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1167.246520] env[69559]: INFO networking_nsxv3.common.synchronization [req-b0e1c4de-a55d-4925-91fc-9dd1a6cb4694 req-946c7f01-a5f1-44e1-94a7-18dd619f7b64 service nova] Enqueued Resource ID: 87e13dd6-6cbd-4016-8ae4-1e0300e3e063 with Priority: HIGHEST for action port [ 1167.246758] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_rules [ 1167.246864] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1167.246959] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87e13dd6-6cbd-4016-8ae4-1e0300e3e063 with Priority: HIGHEST for action port [ 1167.247482] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.247604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.247670] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.247857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.247934] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.248814] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.248906] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.249149] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-87e13dd6-6cbd-4016-8ae4-1e0300e3e063 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.249794] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87e13dd6-6cbd-4016-8ae4-1e0300e3e063" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.249893] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87e13dd6-6cbd-4016-8ae4-1e0300e3e063" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.250132] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87e13dd6-6cbd-4016-8ae4-1e0300e3e063" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.250233] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87e13dd6-6cbd-4016-8ae4-1e0300e3e063',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.752271] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.752408] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.752608] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 87e13dd6-6cbd-4016-8ae4-1e0300e3e063 with status ACTIVE [ 1167.752818] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.752962] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.753060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.753307] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.753402] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.753602] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.753704] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.753767] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.753946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.754036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.754225] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.754391] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.754488] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.754727] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.754826] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.754976] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 87e13dd6-6cbd-4016-8ae4-1e0300e3e063 is going to be updated. [ 1167.775922] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.776092] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.776137] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.776323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.776449] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.776601] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87e13dd6-6cbd-4016-8ae4-1e0300e3e063" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.743501] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1168.743824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.743865] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.744103] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.745499] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.745499] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.745499] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.745499] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.745499] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.745499] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.246845] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.749233] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.251531] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.251776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.251776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.251991] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.252107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.252210] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1170.282302] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.282503] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.282503] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.282771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.283354] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.292201] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1172.247525] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1172.247827] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1172.302080] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1172.302344] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.302511] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.302747] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.303045] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.303045] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.303307] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.303307] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.303414] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.303414] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.303596] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.806025] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.806246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.806246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.806472] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.806638] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.806744] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.806796] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.806940] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.807040] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.807131] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.807282] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.807374] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.807436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.807578] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.807712] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.807804] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.807865] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.808000] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.808088] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.808168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.808256] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.310266] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebf5f404-8f48-487f-b212-72786dc389e8: rpc.has_security_group_logging(os_id): False [ 1173.327961] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.328130] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.328175] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.328390] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.328481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.328673] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.328774] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.328835] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.328985] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.329079] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.329260] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.329369] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.329421] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.329674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.329674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.329869] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.329966] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.330045] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.330164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.330235] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.330321] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1173.390235] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.390403] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.390463] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.390632] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.390771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.420142] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1175.439408] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1175.439992] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.153200] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.153521] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.153521] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.154065] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.154065] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.154248] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.154373] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.154590] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.154753] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.154976] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.155107] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1177.155226] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1177.155343] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1177.155458] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.155570] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1177.155710] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1177.174131] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1177.174303] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1177.174449] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1177.174618] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-815" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.174897] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-d5d9c354-c261-492e-9191-df2862cd2b49 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.175079] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-d5d9c354-c261-492e-9191-df2862cd2b49" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.175208] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-d5d9c354-c261-492e-9191-df2862cd2b49" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.175595] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-d5d9c354-c261-492e-9191-df2862cd2b49" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.175742] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5d9c354-c261-492e-9191-df2862cd2b49',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.249034] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1177.249034] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1177.677582] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.677873] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.677962] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.678287] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.678451] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.678751] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.678945] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.679087] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.679313] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.679461] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.679786] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.679959] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.680098] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.680317] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.680463] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.680610] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: d5d9c354-c261-492e-9191-df2862cd2b49 is going to be updated. [ 1177.701483] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.701706] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.701907] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.702194] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.702393] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.702620] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-d5d9c354-c261-492e-9191-df2862cd2b49" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.469403] env[69559]: INFO networking_nsxv3.common.synchronization [req-8f6bbf0f-29a0-4e14-b973-0585de6bd409 req-ac9fdc16-6345-4542-a398-4cc37eacf5de service nova] Enqueued Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_rules [ 1178.469985] env[69559]: INFO networking_nsxv3.common.synchronization [req-8f6bbf0f-29a0-4e14-b973-0585de6bd409 req-ac9fdc16-6345-4542-a398-4cc37eacf5de service nova] Enqueued Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 1178.470339] env[69559]: INFO networking_nsxv3.common.synchronization [req-8f6bbf0f-29a0-4e14-b973-0585de6bd409 req-ac9fdc16-6345-4542-a398-4cc37eacf5de service nova] Enqueued Resource ID: d5d9c354-c261-492e-9191-df2862cd2b49 with Priority: HIGHEST for action port [ 1178.470915] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_rules [ 1178.471179] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 1178.471529] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5d9c354-c261-492e-9191-df2862cd2b49 with Priority: HIGHEST for action port [ 1178.472332] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.472332] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.472332] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.472525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.472588] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.473670] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.473845] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.473943] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.474201] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.474439] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.474605] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.474713] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.474915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.475045] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.475244] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.475944] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5d9c354-c261-492e-9191-df2862cd2b49 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.476103] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5d9c354-c261-492e-9191-df2862cd2b49" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.476210] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5d9c354-c261-492e-9191-df2862cd2b49" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.476473] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5d9c354-c261-492e-9191-df2862cd2b49" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.476556] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5d9c354-c261-492e-9191-df2862cd2b49',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.979015] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.980415] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.980415] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.982402] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5d9c354-c261-492e-9191-df2862cd2b49 with status ACTIVE [ 1178.982531] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.982658] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.982777] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.982928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.983042] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.983226] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.983328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.983387] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.983545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.983620] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.983803] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.983899] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.983967] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.984126] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.984212] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.984286] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5d9c354-c261-492e-9191-df2862cd2b49 is going to be updated. [ 1179.004168] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.004354] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.004388] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.004656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.004723] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.004865] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5d9c354-c261-492e-9191-df2862cd2b49" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.482115] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.984010] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.984229] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.984305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.984520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.984598] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.984702] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19282542-923d-4b29-8ce7-e30953449122 is going to be updated. [ 1180.014326] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.014508] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.014552] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.014781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.014932] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.022515] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: IN_PROGRESS for 2s [ 1182.034360] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: SUCCESS [ 1182.034717] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.034813] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.035049] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.035203] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.035365] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.035431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.035672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.035672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.035829] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.035829] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.538159] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.538159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.538159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.538409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.538649] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.538780] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.538865] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.539186] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.539186] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.539286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.539422] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.539481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.539531] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.539680] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.539848] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.539941] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.540012] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.540152] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.540230] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.540305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.540379] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.043036] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19282542-923d-4b29-8ce7-e30953449122: rpc.has_security_group_logging(os_id): False [ 1183.062282] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.062475] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.062520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.062709] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.062833] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.063074] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.063205] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.063255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.063408] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.063486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.063693] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.063788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.063850] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.063987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.064083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.064286] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.064380] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.064439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.064573] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.064645] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.064742] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19282542-923d-4b29-8ce7-e30953449122 is going to be updated. [ 1183.121941] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.122124] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.122203] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.122418] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.122587] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.141460] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: IN_PROGRESS for 2s [ 1183.472836] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1183.472976] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1183.721525] env[69559]: INFO networking_nsxv3.common.synchronization [req-098404de-98ac-4d04-93a9-ec58e7f3bdbb req-ea4b939d-bd4a-4af9-815b-aec03d81d346 tempest-ServersTestJSON-514909010 tempest-ServersTestJSON-514909010-project-member] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1183.722485] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1183.722485] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.722726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.722726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.722864] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.723061] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.723188] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.723255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.723416] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.723503] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.723599] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.197068] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-946 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.197068] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-946" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.197400] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-946" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.197400] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-946" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.197669] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.197832] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.197956] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.198190] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.198400] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.198552] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1184.198669] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1184.198784] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1184.198899] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1184.199020] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1184.199135] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1184.199273] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1184.218011] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1184.218156] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1184.218277] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1184.218474] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-946" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.218771] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-5dc09d14-4eb1-43e1-87d3-6f459ebe034e taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.219014] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-5dc09d14-4eb1-43e1-87d3-6f459ebe034e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.219150] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-5dc09d14-4eb1-43e1-87d3-6f459ebe034e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.219441] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-5dc09d14-4eb1-43e1-87d3-6f459ebe034e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.219607] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dc09d14-4eb1-43e1-87d3-6f459ebe034e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.225951] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.286028] env[69559]: INFO networking_nsxv3.common.synchronization [req-1c7342e0-5c75-469e-a541-26fa8ebc4b78 req-cade5391-0443-4ce5-aba7-f31a88701746 tempest-ServerDiskConfigTestJSON-722175017 tempest-ServerDiskConfigTestJSON-722175017-project-member] Enqueued Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1184.286028] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1184.286028] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.286028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.286028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.286028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.286028] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.286028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.286028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.286028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.286028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.286465] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.725364] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.725622] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.725731] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.726040] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.726210] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.726509] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.726676] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.726801] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.727033] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.727183] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.727477] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.727639] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.727773] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.727977] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.728136] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.728284] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 5dc09d14-4eb1-43e1-87d3-6f459ebe034e is going to be updated. [ 1184.729405] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.750485] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.750698] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.750831] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.751109] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.751308] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.751526] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-5dc09d14-4eb1-43e1-87d3-6f459ebe034e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.787768] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.787938] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.787978] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.788254] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.788373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.788594] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.788695] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.788758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.788915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.788991] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.789093] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba is going to be updated. [ 1184.823669] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.823895] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.823982] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.824309] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.824490] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.832374] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: IN_PROGRESS for 2s [ 1185.158839] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: SUCCESS [ 1185.158839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.232341] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.232764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.232764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.232907] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.233012] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.233169] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1185.266893] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.266893] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.267095] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.267242] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.267386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.275502] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1185.545624] env[69559]: INFO networking_nsxv3.common.synchronization [req-e5ff1085-43ea-4ff8-b6c9-3f81dc362931 req-9080d173-1115-43a4-b99b-982fb68f1c1d service nova] Enqueued Resource ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 with Priority: HIGHEST for action security_group_rules [ 1185.545818] env[69559]: INFO networking_nsxv3.common.synchronization [req-e5ff1085-43ea-4ff8-b6c9-3f81dc362931 req-9080d173-1115-43a4-b99b-982fb68f1c1d service nova] Enqueued Resource ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 with Priority: HIGHEST for action security_group_members [ 1185.545968] env[69559]: INFO networking_nsxv3.common.synchronization [req-e5ff1085-43ea-4ff8-b6c9-3f81dc362931 req-9080d173-1115-43a4-b99b-982fb68f1c1d service nova] Enqueued Resource ID: 5dc09d14-4eb1-43e1-87d3-6f459ebe034e with Priority: HIGHEST for action port [ 1185.546212] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 with Priority: HIGHEST for action security_group_rules [ 1185.546336] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 with Priority: HIGHEST for action security_group_members [ 1185.546430] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dc09d14-4eb1-43e1-87d3-6f459ebe034e with Priority: HIGHEST for action port [ 1185.546962] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c048f2fc-8707-43d6-b2f1-033edda0ea00 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.547171] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.547261] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.547486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.549165] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c048f2fc-8707-43d6-b2f1-033edda0ea00',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.549165] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c048f2fc-8707-43d6-b2f1-033edda0ea00 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.549165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.549165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.549165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.549165] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.549165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.549165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.549165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.549554] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.549554] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c048f2fc-8707-43d6-b2f1-033edda0ea00',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.551078] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-5dc09d14-4eb1-43e1-87d3-6f459ebe034e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.551078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5dc09d14-4eb1-43e1-87d3-6f459ebe034e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.551078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5dc09d14-4eb1-43e1-87d3-6f459ebe034e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.551078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5dc09d14-4eb1-43e1-87d3-6f459ebe034e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.551078] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dc09d14-4eb1-43e1-87d3-6f459ebe034e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.053398] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c048f2fc-8707-43d6-b2f1-033edda0ea00',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.054301] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c048f2fc-8707-43d6-b2f1-033edda0ea00 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.054445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.054625] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5dc09d14-4eb1-43e1-87d3-6f459ebe034e with status ACTIVE [ 1186.054792] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.054908] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.054989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.055211] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.055300] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.055472] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.055570] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.055626] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.055772] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.055847] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.056587] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.056727] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.056903] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.057167] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.057265] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.057360] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5dc09d14-4eb1-43e1-87d3-6f459ebe034e is going to be updated. [ 1186.077542] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.077721] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.077776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.077983] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.078246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.078407] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5dc09d14-4eb1-43e1-87d3-6f459ebe034e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.559474] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c048f2fc-8707-43d6-b2f1-033edda0ea00',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.841486] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: SUCCESS [ 1186.841672] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba deletion is rescheduled due to dependency. [ 1186.841784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.061625] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.061824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.061824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.062095] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.062193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.062295] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 is going to be updated. [ 1187.086863] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.087036] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.087112] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.087335] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.087490] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.096297] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 in Status: IN_PROGRESS for 2s [ 1187.284203] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1187.284442] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.875926] env[69559]: INFO networking_nsxv3.common.synchronization [req-831a8023-a24c-465b-bd0d-28773e25319a req-f299f4ad-beea-4108-bb7b-251720174aa9 tempest-ServerDiskConfigTestJSON-722175017 tempest-ServerDiskConfigTestJSON-722175017-project-member] Enqueued Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1187.876354] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1187.876691] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.876749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.876821] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.877144] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.877371] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.877451] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.877501] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.877627] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.877698] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.877784] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.151689] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.151961] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-134" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.152107] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-134" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.152384] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-134" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.152645] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.152813] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.152975] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.153218] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.153374] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.153582] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1188.153701] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1188.153816] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1188.153930] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1188.154053] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1188.154167] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1188.154302] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1188.172139] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1188.172308] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1188.172453] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1188.172625] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-134" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.172943] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-390c132a-4dd3-4e72-927e-3321063f9590 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.173153] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-390c132a-4dd3-4e72-927e-3321063f9590" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.173296] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-390c132a-4dd3-4e72-927e-3321063f9590" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.173581] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-390c132a-4dd3-4e72-927e-3321063f9590" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.173723] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('390c132a-4dd3-4e72-927e-3321063f9590',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.383064] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.383064] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.383064] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.383064] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.383064] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.383064] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.383064] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.383064] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.383455] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.383455] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.383455] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba is going to be updated. [ 1188.418837] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.418986] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.419077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.419268] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.419404] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.434484] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: IN_PROGRESS for 2s [ 1188.676773] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.677072] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.677224] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.677591] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.677826] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.678062] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 390c132a-4dd3-4e72-927e-3321063f9590 not found, creating... [ 1188.678402] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.678649] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.678818] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.679111] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.679338] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.679703] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.679936] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.680151] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.680402] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.680578] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.680754] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 390c132a-4dd3-4e72-927e-3321063f9590 is going to be created. [ 1188.700338] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.700643] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.700643] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.701085] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.701391] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.701666] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-390c132a-4dd3-4e72-927e-3321063f9590" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.105729] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 in Status: SUCCESS [ 1189.106107] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.106174] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.106393] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.106608] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.106726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.106790] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.106944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.107040] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.107129] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.107233] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c048f2fc-8707-43d6-b2f1-033edda0ea00',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.371511] env[69559]: INFO networking_nsxv3.common.synchronization [req-831a8023-a24c-465b-bd0d-28773e25319a req-cf3ec710-c2ae-4104-93ef-49e01b935c0e service nova] Enqueued Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_rules [ 1189.371511] env[69559]: INFO networking_nsxv3.common.synchronization [req-831a8023-a24c-465b-bd0d-28773e25319a req-cf3ec710-c2ae-4104-93ef-49e01b935c0e service nova] Enqueued Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1189.371615] env[69559]: INFO networking_nsxv3.common.synchronization [req-831a8023-a24c-465b-bd0d-28773e25319a req-cf3ec710-c2ae-4104-93ef-49e01b935c0e service nova] Enqueued Resource ID: 390c132a-4dd3-4e72-927e-3321063f9590 with Priority: HIGHEST for action port [ 1189.371988] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_rules [ 1189.372231] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1189.372384] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 390c132a-4dd3-4e72-927e-3321063f9590 with Priority: HIGHEST for action port [ 1189.372998] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.373205] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.373335] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.373605] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.373761] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.374763] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.374910] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.375186] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-390c132a-4dd3-4e72-927e-3321063f9590 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.375343] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-390c132a-4dd3-4e72-927e-3321063f9590" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.375446] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-390c132a-4dd3-4e72-927e-3321063f9590" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.375655] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-390c132a-4dd3-4e72-927e-3321063f9590" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.375767] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('390c132a-4dd3-4e72-927e-3321063f9590',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.609913] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c048f2fc-8707-43d6-b2f1-033edda0ea00',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.878041] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.878983] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.880074] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 390c132a-4dd3-4e72-927e-3321063f9590 with status ACTIVE [ 1189.880317] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.880469] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.880545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.880746] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.880836] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.881030] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.881121] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.881189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.881376] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.881481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.881710] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.881889] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.881972] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.882148] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.882232] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.882349] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 390c132a-4dd3-4e72-927e-3321063f9590 is going to be updated. [ 1189.902777] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.903956] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.903956] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.903956] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.903956] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.903956] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-390c132a-4dd3-4e72-927e-3321063f9590" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.112346] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c048f2fc-8707-43d6-b2f1-033edda0ea00: rpc.has_security_group_logging(os_id): False [ 1190.131601] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.131827] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.131934] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.132297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.132466] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.132800] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.132950] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.133049] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.133227] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.133315] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.133413] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 is going to be updated. [ 1190.196488] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.196678] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.196741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.196908] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.197158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.213549] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 in Status: IN_PROGRESS for 2s [ 1190.231712] env[69559]: INFO networking_nsxv3.common.synchronization [req-99e786a4-0fde-40ba-b535-27aec4595085 req-f00347fd-908d-4a9f-97b3-d5739bb1e4ac tempest-ServerActionsTestOtherA-1414477814 tempest-ServerActionsTestOtherA-1414477814-project-member] Enqueued Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGHEST for action security_group_members [ 1190.232727] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGHEST for action security_group_members [ 1190.232980] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-531bc278-c746-4ada-9fc4-704b99519eae taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.233230] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.233305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.233541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.233721] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.233854] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.233926] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.234100] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.234208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.234318] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.445889] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: SUCCESS [ 1190.446119] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba deletion is rescheduled due to dependency. [ 1190.446245] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.446440] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.446660] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.446876] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.447023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.447094] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.447286] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.447370] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.447466] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.503517] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-964 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.503847] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.504194] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.504559] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.504916] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.505207] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.505425] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.505778] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.506052] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.506417] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1190.506670] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1190.506900] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1190.507138] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1190.507366] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1190.507605] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1190.507872] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1190.527544] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1190.527733] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1190.527887] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1190.528155] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-964" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.528633] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-58eaf56e-536a-451c-9d34-6f1d2f147238 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.528938] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-58eaf56e-536a-451c-9d34-6f1d2f147238" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.529206] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-58eaf56e-536a-451c-9d34-6f1d2f147238" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.529681] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-58eaf56e-536a-451c-9d34-6f1d2f147238" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.529932] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58eaf56e-536a-451c-9d34-6f1d2f147238',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.738055] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.951744] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.032305] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.032512] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.032719] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.033696] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.033853] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.034049] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 58eaf56e-536a-451c-9d34-6f1d2f147238 not found, creating... [ 1191.034435] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.034630] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.034753] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.035059] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.035286] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.035603] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.035818] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.035949] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.036941] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.037254] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.037610] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 58eaf56e-536a-451c-9d34-6f1d2f147238 is going to be created. [ 1191.061917] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.062188] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.062322] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.062610] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.062847] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.063093] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-58eaf56e-536a-451c-9d34-6f1d2f147238" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.240238] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.454144] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.743505] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.743736] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.743802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.744043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.744159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.744267] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 531bc278-c746-4ada-9fc4-704b99519eae is going to be updated. [ 1191.771120] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.771263] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.771341] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.771535] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.771754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.783708] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531bc278-c746-4ada-9fc4-704b99519eae in Status: IN_PROGRESS for 2s [ 1191.794866] env[69559]: INFO networking_nsxv3.common.synchronization [req-99e786a4-0fde-40ba-b535-27aec4595085 req-dd26ac3f-9df4-4362-8843-226bc0072d6a service nova] Enqueued Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGHEST for action security_group_rules [ 1191.795127] env[69559]: INFO networking_nsxv3.common.synchronization [req-99e786a4-0fde-40ba-b535-27aec4595085 req-dd26ac3f-9df4-4362-8843-226bc0072d6a service nova] Enqueued Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGHEST for action security_group_members [ 1191.795278] env[69559]: INFO networking_nsxv3.common.synchronization [req-99e786a4-0fde-40ba-b535-27aec4595085 req-dd26ac3f-9df4-4362-8843-226bc0072d6a service nova] Enqueued Resource ID: 58eaf56e-536a-451c-9d34-6f1d2f147238 with Priority: HIGHEST for action port [ 1191.795833] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGHEST for action security_group_rules [ 1191.795971] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGHEST for action security_group_members [ 1191.798436] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58eaf56e-536a-451c-9d34-6f1d2f147238 with Priority: HIGHEST for action port [ 1191.798835] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-531bc278-c746-4ada-9fc4-704b99519eae taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.798978] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.799071] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.799323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.799408] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.801551] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-531bc278-c746-4ada-9fc4-704b99519eae taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.801551] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.801551] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-58eaf56e-536a-451c-9d34-6f1d2f147238 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.801551] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58eaf56e-536a-451c-9d34-6f1d2f147238" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.801551] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58eaf56e-536a-451c-9d34-6f1d2f147238" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.801551] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58eaf56e-536a-451c-9d34-6f1d2f147238" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.801551] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58eaf56e-536a-451c-9d34-6f1d2f147238',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.961029] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.961029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.961029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.961029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.961029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.961029] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba is going to be updated. [ 1191.992177] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.992177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.992177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.992177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.992177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.008231] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: IN_PROGRESS for 2s [ 1192.230357] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 in Status: SUCCESS [ 1192.230357] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.304131] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-531bc278-c746-4ada-9fc4-704b99519eae taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.304131] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.308022] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58eaf56e-536a-451c-9d34-6f1d2f147238 with status ACTIVE [ 1192.308022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.308022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.308022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.308022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.308022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.308022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.308022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.308022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.308022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.308022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.308022] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.308022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.308022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.308022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.308022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.308022] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58eaf56e-536a-451c-9d34-6f1d2f147238 is going to be updated. [ 1192.328920] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.328920] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.328920] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.328920] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.328920] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.328920] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58eaf56e-536a-451c-9d34-6f1d2f147238" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.793825] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531bc278-c746-4ada-9fc4-704b99519eae in Status: SUCCESS [ 1193.794135] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.794393] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.794630] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.794863] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.795014] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.795120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.795362] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.795449] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.795573] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.017659] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: SUCCESS [ 1194.017858] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.017981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.018224] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.018452] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.018575] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.018644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.018799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.018882] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.018974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.019076] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.298216] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.521056] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.521226] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.521298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.521517] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.521680] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.521780] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.521844] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.522046] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.522145] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.522234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.522383] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.522474] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.522534] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.522672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.522807] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.522924] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.522980] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.523164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.523240] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.523373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.523407] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.531586] env[69559]: INFO networking_nsxv3.common.synchronization [req-6e03a120-2d18-49ea-b250-c33c78c2aa51 req-3b4437ae-298a-455b-a128-b1a8eacc5b1d tempest-ServersTestJSON-514909010 tempest-ServersTestJSON-514909010-project-member] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1194.532298] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGHEST for action security_group_members [ 1194.532835] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.532953] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.533045] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.533229] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.533373] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.533470] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.533532] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.533671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.533749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.533838] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.800480] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.025597] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28bbda40-40d2-4987-875c-100d45eebdba: rpc.has_security_group_logging(os_id): False [ 1195.037042] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.037295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.037295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.037383] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.037445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.037642] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.037740] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.037801] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.037943] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.038031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.038117] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be updated. [ 1195.043626] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.043777] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.043821] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.043956] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.044045] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.044246] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.044340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.044402] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.044575] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.044622] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.044783] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.044876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.044939] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.045087] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.045162] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.045345] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.045437] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.045499] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.045632] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.045735] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.046524] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28bbda40-40d2-4987-875c-100d45eebdba is going to be updated. [ 1195.066227] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.066415] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.066415] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.066618] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.066754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.077839] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: IN_PROGRESS for 2s [ 1195.105319] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.105555] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.105615] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.105862] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.106047] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.132727] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: IN_PROGRESS for 2s [ 1195.303597] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.303597] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.303597] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.303732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.303865] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.303930] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 531bc278-c746-4ada-9fc4-704b99519eae is going to be updated. [ 1195.335860] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.336270] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.336345] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.336668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.336942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.346783] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531bc278-c746-4ada-9fc4-704b99519eae in Status: IN_PROGRESS for 2s [ 1195.373994] env[69559]: INFO networking_nsxv3.common.synchronization [req-f5ec7a0e-30fc-4fbd-a6d7-9ad26c7d0224 req-2bd2fc81-fc2a-47b4-984c-0d67ccdf95fa tempest-ServerActionsTestOtherB-703157979 tempest-ServerActionsTestOtherB-703157979-project-member] Enqueued Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_members [ 1195.374521] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_members [ 1195.374897] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-64914acb-965b-4269-aaa5-676103c45a62 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.374992] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.375114] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.375468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.375468] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.375643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.375727] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.375904] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.376053] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.376216] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.878163] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.878602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.878602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.878724] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.878799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.879097] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.879216] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.879276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.879459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.879537] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.879626] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64914acb-965b-4269-aaa5-676103c45a62 is going to be updated. [ 1195.907549] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.907781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.907857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.908090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.908245] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.918890] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: IN_PROGRESS for 2s [ 1197.087662] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebf5f404-8f48-487f-b212-72786dc389e8 in Status: SUCCESS [ 1197.087662] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 deletion is rescheduled due to dependency. [ 1197.087662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.099655] env[69559]: INFO networking_nsxv3.common.synchronization [req-f3a577f4-def4-49db-ae88-2cf9c2a50238 req-1b8e45e5-906a-4e8a-ba03-4ddb57de4236 tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGHEST for action security_group_members [ 1197.100300] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGHEST for action security_group_members [ 1197.100626] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.100809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.100809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.101030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.101184] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.101287] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.101343] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.101512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.101585] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.102299] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.145136] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: SUCCESS [ 1197.145384] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.356653] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531bc278-c746-4ada-9fc4-704b99519eae in Status: SUCCESS [ 1197.356903] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.357081] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.357296] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.357493] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.357616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.357685] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.357872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.357916] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.358021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.358127] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.604059] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.861170] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.927859] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: SUCCESS [ 1197.928061] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64914acb-965b-4269-aaa5-676103c45a62 deletion is rescheduled due to dependency. [ 1197.928179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.106162] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.363542] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 531bc278-c746-4ada-9fc4-704b99519eae: rpc.has_security_group_logging(os_id): False [ 1198.382583] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.382753] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.382893] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.383211] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.383371] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.383693] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.383871] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.383954] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.384144] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.384229] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.384320] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 531bc278-c746-4ada-9fc4-704b99519eae is going to be updated. [ 1198.440284] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.440437] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.440508] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.440726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.440915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.453287] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 531bc278-c746-4ada-9fc4-704b99519eae in Status: IN_PROGRESS for 2s [ 1198.611745] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.611745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.611745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.612029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.612124] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.612225] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 is going to be updated. [ 1198.651861] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.652614] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.652614] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.652614] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.652614] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.661552] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 in Status: IN_PROGRESS for 2s [ 1200.466283] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 531bc278-c746-4ada-9fc4-704b99519eae in Status: SUCCESS [ 1200.466625] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.671114] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 in Status: SUCCESS [ 1200.671330] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.101255] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1202.101255] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1203.523464] env[69559]: INFO networking_nsxv3.common.synchronization [req-b45f6d9a-735e-4473-82aa-3b61b3ad1378 req-73c0e79e-c1ee-4f6f-83c5-fb36160ea048 tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGHEST for action security_group_members [ 1203.524046] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGHEST for action security_group_members [ 1203.524396] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.524566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.524657] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.524876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.525080] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.525182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.525246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.525436] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.525546] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.525658] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.027521] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.027677] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.027729] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.027928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.028031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.028231] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.028329] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.028392] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.028539] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.028616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.028700] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 is going to be updated. [ 1204.057081] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.057233] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.057280] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.057520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.057683] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.065458] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 in Status: IN_PROGRESS for 2s [ 1204.460267] env[69559]: INFO networking_nsxv3.common.synchronization [req-4a2e9b51-87bc-483f-bdba-139957e3af40 req-91a0e9d2-3ca3-4037-814e-b8e6b108caf6 tempest-ServerActionsTestOtherB-703157979 tempest-ServerActionsTestOtherB-703157979-project-member] Enqueued Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_members [ 1204.460799] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_members [ 1204.461116] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-64914acb-965b-4269-aaa5-676103c45a62 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.461238] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.461302] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.461498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.461647] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.461805] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.461805] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.461957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.462134] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.462351] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.720124] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-289 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.720416] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-289" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.720512] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-289" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.720795] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-289" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.721088] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.721263] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.721390] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.721611] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.721764] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.722037] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1204.722152] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1204.722272] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1204.722388] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1204.722503] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1204.722618] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1204.722758] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1204.741072] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1204.741325] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1204.741524] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1204.741758] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-289" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.742189] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-d3336f2c-5ae1-4511-9257-0f8e33561f2f taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.742371] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-d3336f2c-5ae1-4511-9257-0f8e33561f2f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.742500] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-d3336f2c-5ae1-4511-9257-0f8e33561f2f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.742804] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-d3336f2c-5ae1-4511-9257-0f8e33561f2f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.742952] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3336f2c-5ae1-4511-9257-0f8e33561f2f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.964992] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.965210] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.965317] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.965570] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.965696] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.965974] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.966103] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.966168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.966333] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.966412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.966498] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64914acb-965b-4269-aaa5-676103c45a62 is going to be updated. [ 1204.993580] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.993764] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.993821] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.994008] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.994151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.003263] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: IN_PROGRESS for 2s [ 1205.245121] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.245384] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.245526] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.245867] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.246057] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.246244] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port d3336f2c-5ae1-4511-9257-0f8e33561f2f not found, creating... [ 1205.246567] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.246764] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.246908] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.247190] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.247365] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.247687] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.247966] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.248139] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.248370] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.248537] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.248695] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: d3336f2c-5ae1-4511-9257-0f8e33561f2f is going to be created. [ 1205.270534] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.270753] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.270878] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.271140] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.271370] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.271591] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-d3336f2c-5ae1-4511-9257-0f8e33561f2f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.967856] env[69559]: INFO networking_nsxv3.common.synchronization [req-4a2e9b51-87bc-483f-bdba-139957e3af40 req-d980c85d-a147-4b0d-bf0c-9cc67159709a service nova] Enqueued Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_rules [ 1205.968112] env[69559]: INFO networking_nsxv3.common.synchronization [req-4a2e9b51-87bc-483f-bdba-139957e3af40 req-d980c85d-a147-4b0d-bf0c-9cc67159709a service nova] Enqueued Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_members [ 1205.968200] env[69559]: INFO networking_nsxv3.common.synchronization [req-4a2e9b51-87bc-483f-bdba-139957e3af40 req-d980c85d-a147-4b0d-bf0c-9cc67159709a service nova] Enqueued Resource ID: d3336f2c-5ae1-4511-9257-0f8e33561f2f with Priority: HIGHEST for action port [ 1205.968424] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_rules [ 1205.968552] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_members [ 1205.968646] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3336f2c-5ae1-4511-9257-0f8e33561f2f with Priority: HIGHEST for action port [ 1205.971570] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64914acb-965b-4269-aaa5-676103c45a62 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.971570] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.971570] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.971570] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.971570] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.971764] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-64914acb-965b-4269-aaa5-676103c45a62 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.971853] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.972087] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3336f2c-5ae1-4511-9257-0f8e33561f2f taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.972299] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3336f2c-5ae1-4511-9257-0f8e33561f2f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.972389] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3336f2c-5ae1-4511-9257-0f8e33561f2f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.972568] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3336f2c-5ae1-4511-9257-0f8e33561f2f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.972646] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3336f2c-5ae1-4511-9257-0f8e33561f2f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.074699] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 in Status: SUCCESS [ 1206.074906] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 deletion is rescheduled due to dependency. [ 1206.075040] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.472193] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-64914acb-965b-4269-aaa5-676103c45a62 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.472312] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.474923] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3336f2c-5ae1-4511-9257-0f8e33561f2f with status ACTIVE [ 1206.474995] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.475092] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.475185] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.475636] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.475706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.475890] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.476657] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.476657] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.476657] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.476657] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.476836] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.476836] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.476916] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.477440] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.477440] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.477440] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3336f2c-5ae1-4511-9257-0f8e33561f2f is going to be updated. [ 1206.498443] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.498443] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.498443] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.498639] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.499593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.499593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3336f2c-5ae1-4511-9257-0f8e33561f2f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.012288] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: SUCCESS [ 1207.012579] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64914acb-965b-4269-aaa5-676103c45a62 deletion is rescheduled due to dependency. [ 1207.012579] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.012719] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.012919] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.013139] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.013260] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.013310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.013460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.013539] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.013630] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.515425] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.017984] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.519836] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.520095] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.520095] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.520292] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.520417] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.520481] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64914acb-965b-4269-aaa5-676103c45a62 is going to be updated. [ 1208.546285] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.546515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.546515] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.546759] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.546917] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.554447] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: IN_PROGRESS for 2s [ 1210.565587] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: SUCCESS [ 1210.565935] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.565975] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.566230] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.566456] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.566595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.566664] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.566818] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.566917] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.567026] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.567125] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.973392] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1210.973503] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1211.069150] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.191564] env[69559]: INFO networking_nsxv3.common.synchronization [None req-566270b5-f8b4-4cd3-b5c9-d6440d935923 tempest-AttachInterfacesTestJSON-1312265109 tempest-AttachInterfacesTestJSON-1312265109-project-member] Enqueued Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 1211.192220] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGHEST for action security_group_members [ 1211.192987] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.192987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.192987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.192987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.193300] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.193300] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.193300] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.193404] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.193434] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.193540] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.571528] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64914acb-965b-4269-aaa5-676103c45a62: rpc.has_security_group_logging(os_id): False [ 1211.588265] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.588445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.588514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.588744] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.588855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.589158] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.589272] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.589340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.589519] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.589589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.589670] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64914acb-965b-4269-aaa5-676103c45a62 is going to be updated. [ 1211.647432] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.647628] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.647677] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.647881] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.648049] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.659610] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: IN_PROGRESS for 2s [ 1211.695523] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.695705] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.695750] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.695975] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.696087] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.696344] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.696492] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.696492] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.696648] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.696648] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.696780] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19282542-923d-4b29-8ce7-e30953449122 is going to be updated. [ 1211.744423] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.744634] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.744634] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.744828] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.744973] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.762353] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: IN_PROGRESS for 2s [ 1212.547869] env[69559]: INFO networking_nsxv3.common.synchronization [req-011ec2b6-0260-42e0-bbab-6a693b133fbf req-6a08c837-97bc-42ba-865d-0053fe82cad8 tempest-ServerDiskConfigTestJSON-722175017 tempest-ServerDiskConfigTestJSON-722175017-project-member] Enqueued Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1212.547869] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1212.547869] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.547869] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.547869] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.548092] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.548092] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.548178] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.548248] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.548399] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.548492] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.548583] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.052276] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.052276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.052276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.052276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.052276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.052276] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.052276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.052276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.052276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.052276] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.052276] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba is going to be updated. [ 1213.083602] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.083602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.083602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.083602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.083602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.090566] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: IN_PROGRESS for 2s [ 1213.679468] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: SUCCESS [ 1213.679719] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.771787] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19282542-923d-4b29-8ce7-e30953449122 in Status: SUCCESS [ 1213.772016] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19282542-923d-4b29-8ce7-e30953449122 deletion is rescheduled due to dependency. [ 1213.772269] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.100606] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: SUCCESS [ 1215.101573] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba deletion is rescheduled due to dependency. [ 1215.101573] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.741188] env[69559]: INFO networking_nsxv3.common.synchronization [None req-30429022-d260-444a-9170-a5f85bf79279 None None] Enqueued Resource ID: 5da20c2f-67ee-4ad4-80c6-85c3385bde2e with Priority: HIGHEST for action port [ 1215.741188] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da20c2f-67ee-4ad4-80c6-85c3385bde2e with Priority: HIGHEST for action port [ 1215.741188] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-5da20c2f-67ee-4ad4-80c6-85c3385bde2e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.741188] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5da20c2f-67ee-4ad4-80c6-85c3385bde2e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.741188] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5da20c2f-67ee-4ad4-80c6-85c3385bde2e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.741952] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5da20c2f-67ee-4ad4-80c6-85c3385bde2e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.742089] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5da20c2f-67ee-4ad4-80c6-85c3385bde2e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.100783] env[69559]: INFO networking_nsxv3.common.synchronization [None req-c9711ef7-e843-4125-9400-f29ffb278eb0 tempest-ServerActionsTestJSON-823938086 tempest-ServerActionsTestJSON-823938086-project-member] Enqueued Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_rules [ 1216.100783] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_rules [ 1216.100783] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41335c92-c800-4132-b9ed-f33981d30f6d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.100783] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.101366] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.101648] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.102738] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.201625] env[69559]: INFO networking_nsxv3.common.synchronization [None req-0468063e-7897-47f6-b838-1da9ede668c4 tempest-ServerActionsTestJSON-823938086 tempest-ServerActionsTestJSON-823938086-project-member] Enqueued Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_rules [ 1216.202260] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_rules [ 1216.202604] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41335c92-c800-4132-b9ed-f33981d30f6d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.202715] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.243650] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5da20c2f-67ee-4ad4-80c6-85c3385bde2e [ 1216.244688] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.244688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.244688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.244688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.244688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.244688] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5da20c2f-67ee-4ad4-80c6-85c3385bde2e already deleted. [ 1216.244688] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5da20c2f-67ee-4ad4-80c6-85c3385bde2e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.621686] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.621831] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.621903] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.622189] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.622293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.622397] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41335c92-c800-4132-b9ed-f33981d30f6d already deleted. [ 1216.622482] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.622622] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.622780] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.622863] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.813765] env[69559]: INFO networking_nsxv3.common.synchronization [req-22784005-28de-4036-af30-62eec98987c4 req-fab10f50-798c-42e3-a36b-360b5e547a1b tempest-AttachVolumeNegativeTest-1400300488 tempest-AttachVolumeNegativeTest-1400300488-project-member] Enqueued Resource ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa with Priority: HIGHEST for action security_group_members [ 1216.815106] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa with Priority: HIGHEST for action security_group_members [ 1216.815106] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.815106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.815106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.815106] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.815357] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.815357] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.815357] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.815561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.815561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.815635] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.143652] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.143652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.143652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.143652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.143652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.143652] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41335c92-c800-4132-b9ed-f33981d30f6d already deleted. [ 1217.143652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.319204] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.319395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.319441] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.319640] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.319734] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.319927] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.320043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.320105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.320243] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.320320] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.321076] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa is going to be updated. [ 1217.347405] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.347405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.347405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.347720] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.347720] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.356360] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa in Status: IN_PROGRESS for 2s [ 1217.638928] env[69559]: INFO networking_nsxv3.common.synchronization [None req-9f623bda-d3d6-4c79-9e38-c7ad109375ea None None] Enqueued Resource ID: 9a7851c8-59fa-4e41-8f87-7e4cb309275b with Priority: HIGHEST for action port [ 1217.639316] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a7851c8-59fa-4e41-8f87-7e4cb309275b with Priority: HIGHEST for action port [ 1217.640169] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a7851c8-59fa-4e41-8f87-7e4cb309275b taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.640169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a7851c8-59fa-4e41-8f87-7e4cb309275b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.640169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a7851c8-59fa-4e41-8f87-7e4cb309275b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.640508] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a7851c8-59fa-4e41-8f87-7e4cb309275b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.640589] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a7851c8-59fa-4e41-8f87-7e4cb309275b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.142351] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a7851c8-59fa-4e41-8f87-7e4cb309275b [ 1218.142595] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.142732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.142802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.143019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.143119] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.143262] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a7851c8-59fa-4e41-8f87-7e4cb309275b already deleted. [ 1218.143366] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a7851c8-59fa-4e41-8f87-7e4cb309275b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.599911] env[69559]: INFO networking_nsxv3.common.synchronization [req-7c4a6911-4c92-4e97-838d-741a4ac36b13 req-1faa8658-3bb3-4410-8f5b-eeb0c7af84f6 tempest-AttachVolumeTestJSON-949454441 tempest-AttachVolumeTestJSON-949454441-project-member] Enqueued Resource ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 with Priority: HIGHEST for action security_group_members [ 1218.600514] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 with Priority: HIGHEST for action security_group_members [ 1218.600841] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-18ff4996-ee34-4aa9-8c27-09de3d4a6f74 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.600964] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.601568] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.601801] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.602043] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.602212] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.602292] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.602485] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.602549] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.602609] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18ff4996-ee34-4aa9-8c27-09de3d4a6f74',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.089406] env[69559]: INFO networking_nsxv3.common.synchronization [req-76a2785b-35e2-4651-8033-662c50d19bda req-70ec1b67-0b5d-4ed1-9128-1ab8aa8b2e1f tempest-ServerDiskConfigTestJSON-722175017 tempest-ServerDiskConfigTestJSON-722175017-project-member] Enqueued Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1219.089925] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1219.090324] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.090492] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.090571] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.090773] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.090933] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.091073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.091166] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.091364] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.091364] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.095115] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.105262] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.105262] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.105262] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.105262] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.105262] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.105262] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.105561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.105561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.105561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.105671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.105671] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 is going to be updated. [ 1219.131533] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.131678] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.131845] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.131948] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.132109] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.140644] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 in Status: IN_PROGRESS for 2s [ 1219.367297] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa in Status: SUCCESS [ 1219.367503] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa deletion is rescheduled due to dependency. [ 1219.367617] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.392576] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.393487] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-134" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.393487] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-134" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.393487] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-134" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.393487] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.393716] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.393716] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.394133] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.394133] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.394386] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1219.394524] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1219.394524] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1219.394640] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1219.394752] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1219.394864] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1219.395020] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1219.413500] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1219.413694] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1219.413849] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1219.413998] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-134" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.414327] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-bf18e0e0-4a76-4d3e-be51-f077f2d2d765 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.414810] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-bf18e0e0-4a76-4d3e-be51-f077f2d2d765" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.414810] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-bf18e0e0-4a76-4d3e-be51-f077f2d2d765" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.415069] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-bf18e0e0-4a76-4d3e-be51-f077f2d2d765" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.415140] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf18e0e0-4a76-4d3e-be51-f077f2d2d765',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.593530] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.593706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.593769] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.595159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.595159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.595159] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.595159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.595159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.595159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.595159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.595159] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba is going to be updated. [ 1219.634330] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.634330] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.634330] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.635271] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.635271] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.745924] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: IN_PROGRESS for 2s [ 1219.918112] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.918370] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.918505] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.918799] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.918955] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.920370] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port bf18e0e0-4a76-4d3e-be51-f077f2d2d765 not found, creating... [ 1219.920370] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.920370] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.920370] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.920370] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.920370] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.920699] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.920699] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.920804] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.920933] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.921109] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.921233] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: bf18e0e0-4a76-4d3e-be51-f077f2d2d765 is going to be created. [ 1219.940618] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.940783] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.940892] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.941203] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.941434] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.941659] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-bf18e0e0-4a76-4d3e-be51-f077f2d2d765" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.667486] env[69559]: INFO networking_nsxv3.common.synchronization [req-76a2785b-35e2-4651-8033-662c50d19bda req-deb0d48d-e939-45f2-bb50-8152d1784d8b service nova] Enqueued Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_rules [ 1220.667724] env[69559]: INFO networking_nsxv3.common.synchronization [req-76a2785b-35e2-4651-8033-662c50d19bda req-deb0d48d-e939-45f2-bb50-8152d1784d8b service nova] Enqueued Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1220.667775] env[69559]: INFO networking_nsxv3.common.synchronization [req-76a2785b-35e2-4651-8033-662c50d19bda req-deb0d48d-e939-45f2-bb50-8152d1784d8b service nova] Enqueued Resource ID: bf18e0e0-4a76-4d3e-be51-f077f2d2d765 with Priority: HIGHEST for action port [ 1220.668286] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_rules [ 1220.668434] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1220.668535] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf18e0e0-4a76-4d3e-be51-f077f2d2d765 with Priority: HIGHEST for action port [ 1220.668806] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.668932] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.669007] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.669213] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.669309] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.670171] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.670269] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.670456] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf18e0e0-4a76-4d3e-be51-f077f2d2d765 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.670612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf18e0e0-4a76-4d3e-be51-f077f2d2d765" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.670728] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf18e0e0-4a76-4d3e-be51-f077f2d2d765" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.670790] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf18e0e0-4a76-4d3e-be51-f077f2d2d765" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.670863] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf18e0e0-4a76-4d3e-be51-f077f2d2d765',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.151381] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 in Status: SUCCESS [ 1221.151609] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 deletion is rescheduled due to dependency. [ 1221.151788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.173415] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.173557] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.174644] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf18e0e0-4a76-4d3e-be51-f077f2d2d765 with status ACTIVE [ 1221.174644] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.174644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.174644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.174644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.174644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.174644] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.174644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.175207] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.175207] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.175207] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.175312] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.175439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.175542] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.175694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.175792] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.175899] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf18e0e0-4a76-4d3e-be51-f077f2d2d765 is going to be updated. [ 1221.195060] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.195242] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.195378] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.195623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.195789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.195970] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf18e0e0-4a76-4d3e-be51-f077f2d2d765" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.754939] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: SUCCESS [ 1221.755298] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba deletion is rescheduled due to dependency. [ 1221.755298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.755530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.755700] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.755890] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.756021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.756089] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.756246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.756340] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.756445] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.258661] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.760405] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.262988] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.263199] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.263300] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.263591] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.263741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.263741] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba is going to be updated. [ 1223.295903] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.295903] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.295903] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.295903] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.295903] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.316176] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: IN_PROGRESS for 2s [ 1225.326298] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: SUCCESS [ 1225.326681] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.326681] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.326857] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.327058] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.327180] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.327246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.327403] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.327486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.327569] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.327659] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.669392] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1225.669497] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1225.754126] env[69559]: INFO networking_nsxv3.common.synchronization [req-adcdd2fc-8b29-4cec-be21-60fd300ffb86 req-13f87581-62be-45c5-87a1-0cdb85f4231b tempest-ServerActionsTestJSON-823938086 tempest-ServerActionsTestJSON-823938086-project-member] Enqueued Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_members [ 1225.754126] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_members [ 1225.754585] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-41335c92-c800-4132-b9ed-f33981d30f6d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.754585] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.754684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.754871] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.755530] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.755678] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.755754] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.755948] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.756064] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.756176] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.829502] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.829702] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.829702] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.829918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.830135] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.830267] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.830327] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.830499] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.830614] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.830730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.830904] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.831025] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.831089] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.831256] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.831419] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.831530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.831599] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.831760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.831853] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.831952] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.832069] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.017028] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.017170] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-978" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.017225] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-978" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.017547] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-978" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.017857] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.018152] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.018310] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.018764] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.018764] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.018907] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1226.019041] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1226.019164] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1226.019286] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1226.019408] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1226.019523] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1226.019666] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1226.038007] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1226.038192] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1226.038341] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1226.038596] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-978" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.038918] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-cb84993f-6a63-4be9-8bd1-7046820ca52f taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.039106] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-cb84993f-6a63-4be9-8bd1-7046820ca52f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.039235] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-cb84993f-6a63-4be9-8bd1-7046820ca52f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.039527] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-cb84993f-6a63-4be9-8bd1-7046820ca52f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.039670] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb84993f-6a63-4be9-8bd1-7046820ca52f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.258276] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.258488] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.258537] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.258721] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.258813] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.259021] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.259119] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.259181] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.259333] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.259411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.259497] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41335c92-c800-4132-b9ed-f33981d30f6d already deleted. [ 1226.259575] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.335039] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28bbda40-40d2-4987-875c-100d45eebdba: rpc.has_security_group_logging(os_id): False [ 1226.352270] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.352442] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.352496] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.352677] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.352768] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.352986] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.353576] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.353576] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.353576] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.353576] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.353576] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.353815] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.353815] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.353815] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.353915] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.354093] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.354193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.354254] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.354394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.354468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.354562] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28bbda40-40d2-4987-875c-100d45eebdba is going to be updated. [ 1226.409732] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.409896] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.409971] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.410207] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.410357] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.423249] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: IN_PROGRESS for 2s [ 1226.548847] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.548847] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.548847] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.548847] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.548847] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.548847] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port cb84993f-6a63-4be9-8bd1-7046820ca52f not found, creating... [ 1226.548847] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.548847] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.548847] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.548847] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.548847] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.549461] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.549461] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.549461] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.549461] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.549461] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.549461] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: cb84993f-6a63-4be9-8bd1-7046820ca52f is going to be created. [ 1226.582324] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.582324] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.582491] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.582677] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.583047] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.583154] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-cb84993f-6a63-4be9-8bd1-7046820ca52f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.305237] env[69559]: INFO networking_nsxv3.common.synchronization [req-adcdd2fc-8b29-4cec-be21-60fd300ffb86 req-9653ea47-559f-49d4-9702-23b01b6486ef service nova] Enqueued Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_rules [ 1227.305237] env[69559]: INFO networking_nsxv3.common.synchronization [req-adcdd2fc-8b29-4cec-be21-60fd300ffb86 req-9653ea47-559f-49d4-9702-23b01b6486ef service nova] Enqueued Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_members [ 1227.305237] env[69559]: INFO networking_nsxv3.common.synchronization [req-adcdd2fc-8b29-4cec-be21-60fd300ffb86 req-9653ea47-559f-49d4-9702-23b01b6486ef service nova] Enqueued Resource ID: cb84993f-6a63-4be9-8bd1-7046820ca52f with Priority: HIGHEST for action port [ 1227.305369] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_rules [ 1227.305535] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_members [ 1227.305574] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb84993f-6a63-4be9-8bd1-7046820ca52f with Priority: HIGHEST for action port [ 1227.306242] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41335c92-c800-4132-b9ed-f33981d30f6d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.306412] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.306483] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.306680] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.306888] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.307939] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-41335c92-c800-4132-b9ed-f33981d30f6d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.308067] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.308138] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.308494] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.308650] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.308747] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.308811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.309083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.309196] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.312049] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.312049] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb84993f-6a63-4be9-8bd1-7046820ca52f taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.312049] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb84993f-6a63-4be9-8bd1-7046820ca52f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.312049] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb84993f-6a63-4be9-8bd1-7046820ca52f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.312049] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb84993f-6a63-4be9-8bd1-7046820ca52f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.312049] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb84993f-6a63-4be9-8bd1-7046820ca52f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.565303] env[69559]: INFO networking_nsxv3.common.synchronization [None req-4ca5527f-cd88-4f5b-a62c-932526ce01bf tempest-AttachVolumeTestJSON-949454441 tempest-AttachVolumeTestJSON-949454441-project-member] Enqueued Resource ID: f1350317-f20b-48cd-9c48-1538fbce57b1 with Priority: HIGHEST for action security_group_rules [ 1227.565793] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1350317-f20b-48cd-9c48-1538fbce57b1 with Priority: HIGHEST for action security_group_rules [ 1227.566102] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1350317-f20b-48cd-9c48-1538fbce57b1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.566225] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.566294] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.566558] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.566640] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1350317-f20b-48cd-9c48-1538fbce57b1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.631619] env[69559]: INFO networking_nsxv3.common.synchronization [None req-5b6c9a3a-516b-4dd4-b9fe-78ada9534375 tempest-AttachVolumeTestJSON-949454441 tempest-AttachVolumeTestJSON-949454441-project-member] Enqueued Resource ID: f1350317-f20b-48cd-9c48-1538fbce57b1 with Priority: HIGHEST for action security_group_rules [ 1227.632566] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1350317-f20b-48cd-9c48-1538fbce57b1 with Priority: HIGHEST for action security_group_rules [ 1227.632566] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1350317-f20b-48cd-9c48-1538fbce57b1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.632566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.814190] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.815252] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-41335c92-c800-4132-b9ed-f33981d30f6d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.815364] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.816830] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb84993f-6a63-4be9-8bd1-7046820ca52f with status ACTIVE [ 1227.817013] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.817794] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.817896] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.818147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.818273] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.818474] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.818602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.818696] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.818863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.818949] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.819145] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.819231] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.819293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.819457] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.819534] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.819618] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb84993f-6a63-4be9-8bd1-7046820ca52f is going to be updated. [ 1227.839349] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.839349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.839349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.839545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.839545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.839741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb84993f-6a63-4be9-8bd1-7046820ca52f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.086018] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.086182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.086241] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.086449] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.086534] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.086627] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1350317-f20b-48cd-9c48-1538fbce57b1 already deleted. [ 1228.086711] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.086850] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.087013] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.087093] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1350317-f20b-48cd-9c48-1538fbce57b1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.316767] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.443491] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: SUCCESS [ 1228.443706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.605889] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.606208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.606208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.606325] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.606413] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.606735] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1350317-f20b-48cd-9c48-1538fbce57b1 already deleted. [ 1228.606735] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.819403] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.819644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.819748] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.819985] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.820120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.820264] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41335c92-c800-4132-b9ed-f33981d30f6d is going to be created. [ 1228.852232] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.852232] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.852232] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.852608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.852608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.861965] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: UNINITIALIZED for 2s [ 1230.873022] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: SUCCESS [ 1230.873425] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.873425] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.873627] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.873853] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.873992] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.874085] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.874258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.874370] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.874470] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.874603] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.377709] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.881579] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 41335c92-c800-4132-b9ed-f33981d30f6d: rpc.has_security_group_logging(os_id): False [ 1231.898744] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.898983] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.898983] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.899246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.899246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.899493] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.899586] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.899650] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.899801] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.899873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.899959] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41335c92-c800-4132-b9ed-f33981d30f6d is going to be created. [ 1231.960173] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.960349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.960397] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.960608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.960984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.970244] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: IN_PROGRESS for 2s [ 1232.632992] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1232.633145] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1233.375057] env[69559]: INFO networking_nsxv3.common.synchronization [req-2421cfb3-2215-4646-8b43-bf530d101f0a req-f6f99de8-e3b4-4dd1-8a34-13d56f2a79a8 tempest-AttachVolumeTestJSON-949454441 tempest-AttachVolumeTestJSON-949454441-project-member] Enqueued Resource ID: f1350317-f20b-48cd-9c48-1538fbce57b1 with Priority: HIGHEST for action security_group_members [ 1233.375637] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1350317-f20b-48cd-9c48-1538fbce57b1 with Priority: HIGHEST for action security_group_members [ 1233.375987] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1350317-f20b-48cd-9c48-1538fbce57b1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.376141] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.376238] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.376533] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.376720] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.376834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.376899] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.377073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.377159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.377253] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1350317-f20b-48cd-9c48-1538fbce57b1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.649255] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-837 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.649365] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-837" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.649832] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-837" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.649832] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-837" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.650730] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.651594] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.651880] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.652304] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.652686] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.653111] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1233.653715] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1233.653967] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1233.656018] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1233.656018] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1233.656018] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1233.656018] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1233.674407] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1233.675488] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1233.675488] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1233.677023] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-837" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.677023] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-a91d5f6a-37b2-41ce-9625-ad3de73f8c5c taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.677023] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-a91d5f6a-37b2-41ce-9625-ad3de73f8c5c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.677023] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-a91d5f6a-37b2-41ce-9625-ad3de73f8c5c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.677673] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-a91d5f6a-37b2-41ce-9625-ad3de73f8c5c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.678082] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a91d5f6a-37b2-41ce-9625-ad3de73f8c5c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.881652] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.881652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.881652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.881652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.881652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.881652] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.881652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.881652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.881652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.881652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.881652] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1350317-f20b-48cd-9c48-1538fbce57b1 already deleted. [ 1233.881652] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.981546] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: SUCCESS [ 1233.981806] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.184033] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.184033] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.184033] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.184033] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.184033] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.184033] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port a91d5f6a-37b2-41ce-9625-ad3de73f8c5c not found, creating... [ 1234.184033] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.184033] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.184033] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.184033] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.184033] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.184645] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.184645] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.184645] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.185103] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.185304] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.185460] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: a91d5f6a-37b2-41ce-9625-ad3de73f8c5c is going to be created. [ 1234.205071] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.205290] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.205423] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.205685] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.205908] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.206146] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-a91d5f6a-37b2-41ce-9625-ad3de73f8c5c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.000297] env[69559]: INFO networking_nsxv3.common.synchronization [req-2421cfb3-2215-4646-8b43-bf530d101f0a req-07381892-38f7-44ad-bf5c-93130792c65d service nova] Enqueued Resource ID: f1350317-f20b-48cd-9c48-1538fbce57b1 with Priority: HIGHEST for action security_group_rules [ 1235.000297] env[69559]: INFO networking_nsxv3.common.synchronization [req-2421cfb3-2215-4646-8b43-bf530d101f0a req-07381892-38f7-44ad-bf5c-93130792c65d service nova] Enqueued Resource ID: f1350317-f20b-48cd-9c48-1538fbce57b1 with Priority: HIGHEST for action security_group_members [ 1235.000297] env[69559]: INFO networking_nsxv3.common.synchronization [req-2421cfb3-2215-4646-8b43-bf530d101f0a req-07381892-38f7-44ad-bf5c-93130792c65d service nova] Enqueued Resource ID: a91d5f6a-37b2-41ce-9625-ad3de73f8c5c with Priority: HIGHEST for action port [ 1235.000297] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1350317-f20b-48cd-9c48-1538fbce57b1 with Priority: HIGHEST for action security_group_rules [ 1235.000297] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1350317-f20b-48cd-9c48-1538fbce57b1 with Priority: HIGHEST for action security_group_members [ 1235.000297] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a91d5f6a-37b2-41ce-9625-ad3de73f8c5c with Priority: HIGHEST for action port [ 1235.000297] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1350317-f20b-48cd-9c48-1538fbce57b1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.000297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.000297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.000297] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.001878] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1350317-f20b-48cd-9c48-1538fbce57b1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.003832] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1350317-f20b-48cd-9c48-1538fbce57b1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.003964] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.004049] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.004251] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.004576] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.004576] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.004576] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.004726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.004799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.004892] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1350317-f20b-48cd-9c48-1538fbce57b1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.005702] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-a91d5f6a-37b2-41ce-9625-ad3de73f8c5c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.005811] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a91d5f6a-37b2-41ce-9625-ad3de73f8c5c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.006692] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a91d5f6a-37b2-41ce-9625-ad3de73f8c5c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.006692] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a91d5f6a-37b2-41ce-9625-ad3de73f8c5c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.006692] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a91d5f6a-37b2-41ce-9625-ad3de73f8c5c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.512450] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f1350317-f20b-48cd-9c48-1538fbce57b1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.513586] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1350317-f20b-48cd-9c48-1538fbce57b1 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.514241] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.514241] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a91d5f6a-37b2-41ce-9625-ad3de73f8c5c with status ACTIVE [ 1235.514241] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.514241] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.514241] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.514464] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.514500] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.514698] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.514793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.514793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.514998] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.515086] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.515210] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.515295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.515349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.515485] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.515558] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.515637] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a91d5f6a-37b2-41ce-9625-ad3de73f8c5c is going to be updated. [ 1235.536932] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.537095] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.537275] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.537388] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.537673] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.537673] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a91d5f6a-37b2-41ce-9625-ad3de73f8c5c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.018220] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f1350317-f20b-48cd-9c48-1538fbce57b1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.521559] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.521789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.521789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.521946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.522281] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.522426] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1350317-f20b-48cd-9c48-1538fbce57b1 is going to be created. [ 1236.551225] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.551420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.551420] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.551639] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.551795] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.561568] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1350317-f20b-48cd-9c48-1538fbce57b1 in Status: UNINITIALIZED for 2s [ 1238.573559] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1350317-f20b-48cd-9c48-1538fbce57b1 in Status: SUCCESS [ 1238.573797] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.573932] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.574172] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.574370] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.574484] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.574546] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.574693] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.574771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.574853] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.574942] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f1350317-f20b-48cd-9c48-1538fbce57b1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.077302] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f1350317-f20b-48cd-9c48-1538fbce57b1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.580584] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f1350317-f20b-48cd-9c48-1538fbce57b1: rpc.has_security_group_logging(os_id): False [ 1239.598753] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.599391] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.599391] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.599391] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.599391] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.599608] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.599676] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.599729] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.599872] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.600725] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.600725] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1350317-f20b-48cd-9c48-1538fbce57b1 is going to be created. [ 1239.655868] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.655998] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.656058] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.656253] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.656432] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.666731] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1350317-f20b-48cd-9c48-1538fbce57b1 in Status: IN_PROGRESS for 2s [ 1240.000029] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1240.000215] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1241.680543] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1350317-f20b-48cd-9c48-1538fbce57b1 in Status: SUCCESS [ 1241.680840] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.220812] env[69559]: INFO networking_nsxv3.common.synchronization [req-32d2b91f-5446-43f8-b468-388f05531f3a req-d839cb7f-e6fd-4e2b-ab0a-d350ea5946b6 tempest-AttachVolumeShelveTestJSON-1912655505 tempest-AttachVolumeShelveTestJSON-1912655505-project-member] Enqueued Resource ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 with Priority: HIGHEST for action security_group_members [ 1244.221370] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 with Priority: HIGHEST for action security_group_members [ 1244.221678] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-c048f2fc-8707-43d6-b2f1-033edda0ea00 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.221803] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.221878] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.222077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.222227] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.222327] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.222388] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.222615] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.222715] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.222809] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c048f2fc-8707-43d6-b2f1-033edda0ea00',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.725182] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.725337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.725437] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.725630] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.725741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.725965] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.726090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.726151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.726675] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.726675] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.726675] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 is going to be updated. [ 1244.754367] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.754559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.754604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.754816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.755040] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.764212] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 in Status: IN_PROGRESS for 2s [ 1246.774773] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 in Status: SUCCESS [ 1246.775168] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 deletion is rescheduled due to dependency. [ 1246.775168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.864273] env[69559]: INFO networking_nsxv3.common.synchronization [None req-db04267e-24b9-43a5-8cc8-d08f5b925dc1 tempest-AttachVolumeShelveTestJSON-1912655505 tempest-AttachVolumeShelveTestJSON-1912655505-project-member] Enqueued Resource ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 with Priority: HIGHEST for action security_group_rules [ 1248.864273] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 with Priority: HIGHEST for action security_group_rules [ 1248.864273] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.864273] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.864273] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.864668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.864668] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('830a5dd0-aa9f-42f5-9736-1ee630ab4542',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.944457] env[69559]: INFO networking_nsxv3.common.synchronization [None req-37ee9ea3-fe28-4a76-9bc1-f0084504dbb6 tempest-AttachVolumeShelveTestJSON-1912655505 tempest-AttachVolumeShelveTestJSON-1912655505-project-member] Enqueued Resource ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 with Priority: HIGHEST for action security_group_rules [ 1248.945473] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 with Priority: HIGHEST for action security_group_rules [ 1248.945473] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.945617] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.385877] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.386063] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.386117] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.386662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.386662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.386662] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 already deleted. [ 1249.386662] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.386849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.386964] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.387066] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('830a5dd0-aa9f-42f5-9736-1ee630ab4542',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.909597] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.910015] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.910015] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.910125] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.910125] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.910225] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 already deleted. [ 1249.910307] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.946171] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1253.946487] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1254.260889] env[69559]: INFO networking_nsxv3.common.synchronization [req-61e2f53e-13e9-421f-b694-ed0646d4b04e req-b8886955-ac06-4c53-bbe1-dafd36555618 tempest-AttachVolumeShelveTestJSON-1912655505 tempest-AttachVolumeShelveTestJSON-1912655505-project-member] Enqueued Resource ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 with Priority: HIGHEST for action security_group_members [ 1254.260889] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 with Priority: HIGHEST for action security_group_members [ 1254.261197] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-830a5dd0-aa9f-42f5-9736-1ee630ab4542 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.261322] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.261388] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.261632] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.261789] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.261888] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.261951] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.262260] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.262352] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.262452] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('830a5dd0-aa9f-42f5-9736-1ee630ab4542',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.521846] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-946 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.522074] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-946" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.522205] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-946" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.522474] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-946" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.522802] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.523030] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.523173] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.523395] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.523563] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.523851] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1254.523983] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1254.524113] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1254.524231] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1254.524353] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1254.524466] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1254.524608] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1254.543872] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1254.544098] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1254.544244] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1254.544418] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-946" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.544692] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-b6eeecef-4a97-457e-9d4c-396bd1513672 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.544884] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-b6eeecef-4a97-457e-9d4c-396bd1513672" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.545034] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-b6eeecef-4a97-457e-9d4c-396bd1513672" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.545323] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-b6eeecef-4a97-457e-9d4c-396bd1513672" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.545465] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6eeecef-4a97-457e-9d4c-396bd1513672',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.764228] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.764431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.764482] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.764664] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.764757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.764963] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.765075] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.765139] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.765289] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.765363] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.765447] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 already deleted. [ 1254.765528] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.048707] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.049122] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.049206] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.049565] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.049747] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.049969] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port b6eeecef-4a97-457e-9d4c-396bd1513672 not found, creating... [ 1255.050368] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.050589] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.050738] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.051070] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.051295] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.051655] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.051841] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.052014] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.052352] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.052571] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.052757] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: b6eeecef-4a97-457e-9d4c-396bd1513672 is going to be created. [ 1255.072611] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.072905] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.073866] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.073866] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.074020] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.075058] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-b6eeecef-4a97-457e-9d4c-396bd1513672" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.769206] env[69559]: INFO networking_nsxv3.common.synchronization [req-61e2f53e-13e9-421f-b694-ed0646d4b04e req-c3372577-53cf-4fdf-b077-fc45a397459b service nova] Enqueued Resource ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 with Priority: HIGHEST for action security_group_rules [ 1255.769206] env[69559]: INFO networking_nsxv3.common.synchronization [req-61e2f53e-13e9-421f-b694-ed0646d4b04e req-c3372577-53cf-4fdf-b077-fc45a397459b service nova] Enqueued Resource ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 with Priority: HIGHEST for action security_group_members [ 1255.769206] env[69559]: INFO networking_nsxv3.common.synchronization [req-61e2f53e-13e9-421f-b694-ed0646d4b04e req-c3372577-53cf-4fdf-b077-fc45a397459b service nova] Enqueued Resource ID: b6eeecef-4a97-457e-9d4c-396bd1513672 with Priority: HIGHEST for action port [ 1255.769206] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 with Priority: HIGHEST for action security_group_rules [ 1255.769206] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 with Priority: HIGHEST for action security_group_members [ 1255.769206] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6eeecef-4a97-457e-9d4c-396bd1513672 with Priority: HIGHEST for action port [ 1255.769206] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.769206] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.769206] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.769830] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.770046] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('830a5dd0-aa9f-42f5-9736-1ee630ab4542',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.773164] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-830a5dd0-aa9f-42f5-9736-1ee630ab4542 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.773164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.773164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.773164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.773164] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.773164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.773164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.773164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.773164] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.773164] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('830a5dd0-aa9f-42f5-9736-1ee630ab4542',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.773164] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6eeecef-4a97-457e-9d4c-396bd1513672 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.773773] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6eeecef-4a97-457e-9d4c-396bd1513672" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.773851] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6eeecef-4a97-457e-9d4c-396bd1513672" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.774021] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6eeecef-4a97-457e-9d4c-396bd1513672" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.774096] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6eeecef-4a97-457e-9d4c-396bd1513672',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.275563] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('830a5dd0-aa9f-42f5-9736-1ee630ab4542',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.277083] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-830a5dd0-aa9f-42f5-9736-1ee630ab4542 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.277083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.277389] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6eeecef-4a97-457e-9d4c-396bd1513672 with status ACTIVE [ 1256.277557] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.277676] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.277774] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.277938] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.278044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.278225] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.278342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.278427] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.278602] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.278684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.278875] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.278955] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.279023] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.279413] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.279413] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.279413] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6eeecef-4a97-457e-9d4c-396bd1513672 is going to be updated. [ 1256.299335] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.299484] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.299562] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.299725] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.299858] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.300073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6eeecef-4a97-457e-9d4c-396bd1513672" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.329080] env[69559]: INFO networking_nsxv3.common.synchronization [None req-9ffba1d1-4e2c-4a8f-b309-c3bac73644aa tempest-ServerDiskConfigTestJSON-722175017 tempest-ServerDiskConfigTestJSON-722175017-project-member] Enqueued Resource ID: afa50e4a-0e0a-4493-9178-f81cd87a5da7 with Priority: HIGHEST for action security_group_rules [ 1256.329316] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afa50e4a-0e0a-4493-9178-f81cd87a5da7 with Priority: HIGHEST for action security_group_rules [ 1256.329817] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afa50e4a-0e0a-4493-9178-f81cd87a5da7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.329936] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afa50e4a-0e0a-4493-9178-f81cd87a5da7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.330019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afa50e4a-0e0a-4493-9178-f81cd87a5da7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.330299] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afa50e4a-0e0a-4493-9178-f81cd87a5da7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.330382] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afa50e4a-0e0a-4493-9178-f81cd87a5da7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.397956] env[69559]: INFO networking_nsxv3.common.synchronization [None req-964a6749-a271-40fd-bfc2-bea2afb380ca tempest-ServerDiskConfigTestJSON-722175017 tempest-ServerDiskConfigTestJSON-722175017-project-member] Enqueued Resource ID: afa50e4a-0e0a-4493-9178-f81cd87a5da7 with Priority: HIGHEST for action security_group_rules [ 1256.398406] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afa50e4a-0e0a-4493-9178-f81cd87a5da7 with Priority: HIGHEST for action security_group_rules [ 1256.398702] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afa50e4a-0e0a-4493-9178-f81cd87a5da7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.398802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afa50e4a-0e0a-4493-9178-f81cd87a5da7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.778013] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('830a5dd0-aa9f-42f5-9736-1ee630ab4542',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.849248] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.849394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.849445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.849667] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.849753] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.849844] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afa50e4a-0e0a-4493-9178-f81cd87a5da7 already deleted. [ 1256.849926] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afa50e4a-0e0a-4493-9178-f81cd87a5da7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.850078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afa50e4a-0e0a-4493-9178-f81cd87a5da7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.850231] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afa50e4a-0e0a-4493-9178-f81cd87a5da7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.850309] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afa50e4a-0e0a-4493-9178-f81cd87a5da7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.280030] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.280360] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.280360] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.280445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.280530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.280632] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 is going to be created. [ 1257.302982] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.303147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.303200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.303406] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.303604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.312226] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 in Status: UNINITIALIZED for 2s [ 1257.373456] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.373634] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.373702] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.373882] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.373971] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.374077] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afa50e4a-0e0a-4493-9178-f81cd87a5da7 already deleted. [ 1257.374159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afa50e4a-0e0a-4493-9178-f81cd87a5da7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.249933] env[69559]: INFO networking_nsxv3.common.synchronization [req-d51565ea-d837-4a70-bed3-5f3a62c22257 req-c3d2fd85-2a21-404e-8ba0-2279a6b65caf tempest-ServerDiskConfigTestJSON-722175017 tempest-ServerDiskConfigTestJSON-722175017-project-member] Enqueued Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1259.250822] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1259.251216] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.251422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.251527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.251805] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.251999] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.252088] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.252135] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.252298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.252380] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.252475] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.321293] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 in Status: SUCCESS [ 1259.321508] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.321677] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.322040] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.322094] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.322213] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.322282] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.322431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.322514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.322632] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.322721] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('830a5dd0-aa9f-42f5-9736-1ee630ab4542',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.755301] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.755672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.755672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.755842] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.755842] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.756202] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.756202] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.756202] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.756566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.756566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.756566] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba is going to be updated. [ 1259.782824] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.783051] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.783051] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.783318] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.783461] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.791748] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: IN_PROGRESS for 2s [ 1259.824902] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('830a5dd0-aa9f-42f5-9736-1ee630ab4542',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.327782] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 830a5dd0-aa9f-42f5-9736-1ee630ab4542: rpc.has_security_group_logging(os_id): False [ 1260.345137] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.345351] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.345351] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.345557] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.345645] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.345887] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.345987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.346066] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.346215] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.346290] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.346373] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 is going to be created. [ 1260.404241] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.404453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.404453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.404648] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.404841] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.413813] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 in Status: IN_PROGRESS for 2s [ 1261.802556] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: SUCCESS [ 1261.802556] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba deletion is rescheduled due to dependency. [ 1261.802556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.869987] env[69559]: INFO networking_nsxv3.common.synchronization [req-ee0f8341-e58c-4652-9284-acc422e3343a req-2e49f57f-b829-494c-8e97-3deccd6c56f5 tempest-ServerDiskConfigTestJSON-722175017 tempest-ServerDiskConfigTestJSON-722175017-project-member] Enqueued Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1261.870502] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1261.870857] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.870994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.871093] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.871323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.871488] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.871638] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.871713] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.871887] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.871976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.872098] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.152202] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.152430] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-134" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.152554] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-134" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.152908] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-134" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.153209] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.153384] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.153513] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.153764] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.153920] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.154149] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1262.154275] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1262.154394] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1262.154511] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1262.154636] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1262.154790] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1262.154951] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1262.172843] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1262.173040] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1262.173168] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1262.173351] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-134" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.173676] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-cbb88a11-ddac-4a10-a530-74e8f3cc9e72 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.173881] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-cbb88a11-ddac-4a10-a530-74e8f3cc9e72" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.174018] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-cbb88a11-ddac-4a10-a530-74e8f3cc9e72" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.174407] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-cbb88a11-ddac-4a10-a530-74e8f3cc9e72" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.174554] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbb88a11-ddac-4a10-a530-74e8f3cc9e72',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.373992] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.374229] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.374229] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.374394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.374481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.374685] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.374784] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.374847] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.375016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.375090] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.375176] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba is going to be updated. [ 1262.399112] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.399351] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.399351] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.399512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.399650] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.407898] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: IN_PROGRESS for 2s [ 1262.425515] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 in Status: SUCCESS [ 1262.425722] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.677637] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.677863] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.677986] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.678339] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.678532] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.678744] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port cbb88a11-ddac-4a10-a530-74e8f3cc9e72 not found, creating... [ 1262.679083] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.679314] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.679481] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.679748] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.679938] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.680325] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.680532] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.680757] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.681032] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.681201] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.681383] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: cbb88a11-ddac-4a10-a530-74e8f3cc9e72 is going to be created. [ 1262.701854] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.702134] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.702290] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.702626] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.702892] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.703189] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-cbb88a11-ddac-4a10-a530-74e8f3cc9e72" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.120035] env[69559]: INFO networking_nsxv3.common.synchronization [req-9e8843e7-10a4-4daf-903c-8c9e3b018320 req-4c8c5427-667a-4b81-8580-44bb6bc8b210 tempest-ServerActionsTestOtherA-1414477814 tempest-ServerActionsTestOtherA-1414477814-project-member] Enqueued Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGHEST for action security_group_members [ 1263.120035] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGHEST for action security_group_members [ 1263.120035] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-531bc278-c746-4ada-9fc4-704b99519eae taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.120035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.120035] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.120864] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.121471] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.121471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.121471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.121471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.121471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.121752] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.624174] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.660864] env[69559]: INFO networking_nsxv3.common.synchronization [req-ee0f8341-e58c-4652-9284-acc422e3343a req-ebbee4ad-c795-49ea-85f0-09bbabdbf587 service nova] Enqueued Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_rules [ 1263.661057] env[69559]: INFO networking_nsxv3.common.synchronization [req-ee0f8341-e58c-4652-9284-acc422e3343a req-ebbee4ad-c795-49ea-85f0-09bbabdbf587 service nova] Enqueued Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1263.661196] env[69559]: INFO networking_nsxv3.common.synchronization [req-ee0f8341-e58c-4652-9284-acc422e3343a req-ebbee4ad-c795-49ea-85f0-09bbabdbf587 service nova] Enqueued Resource ID: cbb88a11-ddac-4a10-a530-74e8f3cc9e72 with Priority: HIGHEST for action port [ 1263.661687] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_rules [ 1263.661812] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1263.662262] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbb88a11-ddac-4a10-a530-74e8f3cc9e72 with Priority: HIGHEST for action port [ 1263.662816] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.662924] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.663073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.663209] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.663288] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.664082] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.664174] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.664367] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbb88a11-ddac-4a10-a530-74e8f3cc9e72 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.664465] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbb88a11-ddac-4a10-a530-74e8f3cc9e72" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.664530] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbb88a11-ddac-4a10-a530-74e8f3cc9e72" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.664691] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbb88a11-ddac-4a10-a530-74e8f3cc9e72" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.664765] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbb88a11-ddac-4a10-a530-74e8f3cc9e72',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.126331] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.166867] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.167168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.167351] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cbb88a11-ddac-4a10-a530-74e8f3cc9e72 with status ACTIVE [ 1264.167608] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.167769] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.167875] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.168200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.168339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.168602] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.168757] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.168855] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.169111] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.169236] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.169510] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.169654] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.169750] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.169959] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.170093] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.170228] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cbb88a11-ddac-4a10-a530-74e8f3cc9e72 is going to be updated. [ 1264.192158] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.192365] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.192365] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.192577] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.192893] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.193091] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbb88a11-ddac-4a10-a530-74e8f3cc9e72" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.417697] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: SUCCESS [ 1264.417848] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba deletion is rescheduled due to dependency. [ 1264.417974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.418151] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.418367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.418605] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.418694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.418748] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.418873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.418952] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.419062] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.629048] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.629267] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.629341] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.629508] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.629599] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.629700] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 531bc278-c746-4ada-9fc4-704b99519eae is going to be updated. [ 1264.658973] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.659230] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.659230] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.659419] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.659559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.668087] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531bc278-c746-4ada-9fc4-704b99519eae in Status: IN_PROGRESS for 2s [ 1264.921113] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.423451] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.925968] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.926216] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.926325] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.926535] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.926628] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.926725] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba is going to be updated. [ 1265.954459] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.954668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.954668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.954863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.955032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.963027] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: IN_PROGRESS for 2s [ 1266.679379] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531bc278-c746-4ada-9fc4-704b99519eae in Status: SUCCESS [ 1266.679692] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.973509] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: SUCCESS [ 1267.973865] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.973934] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.974320] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.974553] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.974715] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.974799] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.974986] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.975076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.975168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.975373] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.480078] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.480078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.480078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.480078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.480078] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.480078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.480078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.480078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.480078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.480536] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.480536] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.480536] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.480536] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.480536] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.480702] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.480802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.480856] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.480994] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.481078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.481178] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.481249] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.662976] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1268.663162] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1268.983412] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28bbda40-40d2-4987-875c-100d45eebdba: rpc.has_security_group_logging(os_id): False [ 1269.001193] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.001303] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.001381] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.001617] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.001715] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.001956] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.002100] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.002169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.002325] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.002419] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.002618] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.002737] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.002802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.002944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.003033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.003228] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.003321] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.003382] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.003520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.003595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.003679] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28bbda40-40d2-4987-875c-100d45eebdba is going to be updated. [ 1269.066029] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.066210] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.066337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.066646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.066874] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.079948] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: IN_PROGRESS for 2s [ 1271.096712] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: SUCCESS [ 1271.097045] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.663832] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1273.664236] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1276.702258] env[69559]: INFO networking_nsxv3.common.synchronization [req-f7de448d-6cc3-48ff-bfc7-851ee1bc10a2 req-9c526d32-35a9-4ef7-944e-c04e6ab1a1ae tempest-ServerActionsTestOtherA-1414477814 tempest-ServerActionsTestOtherA-1414477814-project-member] Enqueued Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGHEST for action security_group_members [ 1276.703382] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGHEST for action security_group_members [ 1276.703382] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-531bc278-c746-4ada-9fc4-704b99519eae taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.703529] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.703529] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.704479] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.704479] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.704479] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.704479] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.704479] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.704479] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.704739] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.206583] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.206728] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.206804] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.207054] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.207155] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.207349] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.207450] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.207512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.207665] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.207739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.207824] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 531bc278-c746-4ada-9fc4-704b99519eae is going to be updated. [ 1277.240306] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.240805] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.241066] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.241148] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.241236] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.249139] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531bc278-c746-4ada-9fc4-704b99519eae in Status: IN_PROGRESS for 2s [ 1279.260601] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 531bc278-c746-4ada-9fc4-704b99519eae in Status: SUCCESS [ 1279.260840] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 531bc278-c746-4ada-9fc4-704b99519eae deletion is rescheduled due to dependency. [ 1279.260964] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.667534] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-289 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.667939] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-289" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.667939] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-289" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.668184] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-289" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.668414] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.668577] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.668701] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.668918] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.669088] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.669302] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1280.669420] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1280.669535] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1280.669646] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1280.669758] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1280.669869] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1280.670015] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1280.689156] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1280.689380] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1280.689476] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1280.689655] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-289" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.689965] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-d3336f2c-5ae1-4511-9257-0f8e33561f2f taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.690157] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-d3336f2c-5ae1-4511-9257-0f8e33561f2f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.690284] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-d3336f2c-5ae1-4511-9257-0f8e33561f2f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.690539] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-d3336f2c-5ae1-4511-9257-0f8e33561f2f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.690683] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3336f2c-5ae1-4511-9257-0f8e33561f2f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.195202] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.195437] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.195527] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.195818] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.195981] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.196317] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.196505] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.196633] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.196857] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.197015] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.197310] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.197472] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.197594] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.197828] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.197995] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.198162] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: d3336f2c-5ae1-4511-9257-0f8e33561f2f is going to be updated. [ 1281.220077] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.220279] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.220385] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.220617] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.220831] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.221067] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-d3336f2c-5ae1-4511-9257-0f8e33561f2f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.703761] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1281.704090] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1281.882031] env[69559]: INFO networking_nsxv3.common.synchronization [req-43832db8-f07b-4874-a2eb-ec30afdfb742 req-922bd76e-3915-4499-a86b-452fd4073a71 service nova] Enqueued Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_rules [ 1281.882031] env[69559]: INFO networking_nsxv3.common.synchronization [req-43832db8-f07b-4874-a2eb-ec30afdfb742 req-922bd76e-3915-4499-a86b-452fd4073a71 service nova] Enqueued Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_members [ 1281.882031] env[69559]: INFO networking_nsxv3.common.synchronization [req-43832db8-f07b-4874-a2eb-ec30afdfb742 req-922bd76e-3915-4499-a86b-452fd4073a71 service nova] Enqueued Resource ID: d3336f2c-5ae1-4511-9257-0f8e33561f2f with Priority: HIGHEST for action port [ 1281.882031] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_rules [ 1281.882031] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_members [ 1281.882031] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3336f2c-5ae1-4511-9257-0f8e33561f2f with Priority: HIGHEST for action port [ 1281.882031] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64914acb-965b-4269-aaa5-676103c45a62 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.882031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.882031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.882031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.882031] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.883608] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-64914acb-965b-4269-aaa5-676103c45a62 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.883835] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.884016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.884693] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.884933] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.885168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.885330] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.885812] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.886009] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.886216] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.887159] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3336f2c-5ae1-4511-9257-0f8e33561f2f taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.887377] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3336f2c-5ae1-4511-9257-0f8e33561f2f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.887534] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3336f2c-5ae1-4511-9257-0f8e33561f2f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.887765] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3336f2c-5ae1-4511-9257-0f8e33561f2f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.888400] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3336f2c-5ae1-4511-9257-0f8e33561f2f',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.389701] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-64914acb-965b-4269-aaa5-676103c45a62 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.389933] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.390015] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.390923] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3336f2c-5ae1-4511-9257-0f8e33561f2f with status ACTIVE [ 1282.391111] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.391249] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.391325] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.391490] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.391586] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.391766] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.391862] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.391987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.392099] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.392178] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.392355] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.392448] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.392508] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.392645] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.392720] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.393015] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3336f2c-5ae1-4511-9257-0f8e33561f2f is going to be updated. [ 1282.411970] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.412171] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.412171] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.412343] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.412468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.412613] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3336f2c-5ae1-4511-9257-0f8e33561f2f" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.895169] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.397986] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.398228] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.398293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.398552] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.398914] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.398914] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64914acb-965b-4269-aaa5-676103c45a62 is going to be updated. [ 1283.426844] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.427008] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.427070] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.427410] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.427562] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.435864] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: IN_PROGRESS for 2s [ 1285.446033] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: SUCCESS [ 1285.446384] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.446439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.446612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.446801] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.446918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.446985] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.447147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.447227] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.447310] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.447399] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.949756] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.451673] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64914acb-965b-4269-aaa5-676103c45a62: rpc.has_security_group_logging(os_id): False [ 1286.471298] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.471503] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.471503] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.471719] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.471809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.472062] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.472193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.472267] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.472421] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.472507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.472612] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64914acb-965b-4269-aaa5-676103c45a62 is going to be updated. [ 1286.533590] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.533823] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.533823] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.534212] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.534377] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.564823] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: IN_PROGRESS for 2s [ 1286.882146] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1286.882305] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1288.586089] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: SUCCESS [ 1288.586089] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.733786] env[69559]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1289.734078] env[69559]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1291.883246] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1291.883631] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1296.884334] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1296.884673] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1297.923358] env[69559]: INFO networking_nsxv3.common.synchronization [req-9e500e72-cfed-416b-966c-96c2fab22a4a req-c6957380-73f6-4764-8057-3636acff332b tempest-ServerActionsTestOtherB-703157979 tempest-ServerActionsTestOtherB-703157979-project-member] Enqueued Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_members [ 1297.923786] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGHEST for action security_group_members [ 1297.924237] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-64914acb-965b-4269-aaa5-676103c45a62 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.924386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.924468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.924624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.924776] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.924868] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.924929] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.925427] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.925427] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.925427] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.427969] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.428234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.428234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.428486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.428551] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.428714] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.428821] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.428886] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.429018] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.429096] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.429182] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64914acb-965b-4269-aaa5-676103c45a62 is going to be updated. [ 1298.454835] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.455030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.455030] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.455231] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.455366] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.462651] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: IN_PROGRESS for 2s [ 1300.473078] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64914acb-965b-4269-aaa5-676103c45a62 in Status: SUCCESS [ 1300.473445] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64914acb-965b-4269-aaa5-676103c45a62 deletion is rescheduled due to dependency. [ 1300.473445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.516104] env[69559]: INFO networking_nsxv3.common.synchronization [req-463b28f1-fcc4-484c-b582-4c928ca222ef req-1c48ff27-da2c-4e45-b10a-324062a119ca tempest-ServerDiskConfigTestJSON-722175017 tempest-ServerDiskConfigTestJSON-722175017-project-member] Enqueued Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1302.516309] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1302.516430] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.516430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.516430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.516430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.516430] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.516430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.516430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.516430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.516430] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.516430] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.019605] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.019789] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.019838] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.020075] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.020186] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.020363] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.020459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.020520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.020668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.020743] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.020830] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba is going to be updated. [ 1303.049642] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.049775] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.049835] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.050028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.050169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.057588] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: IN_PROGRESS for 2s [ 1304.692769] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.693219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.693219] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.693355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.693470] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.017177] env[69559]: INFO networking_nsxv3.common.synchronization [req-389a2809-e7f1-4543-8ecc-1fb900382602 req-c8f6ef0d-70a8-4e9e-80b0-9afd1a9d13f0 tempest-ServerDiskConfigTestJSON-722175017 tempest-ServerDiskConfigTestJSON-722175017-project-member] Enqueued Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1305.017702] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1305.018015] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.018125] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.068750] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: SUCCESS [ 1305.068942] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba deletion is rescheduled due to dependency. [ 1305.069079] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.069237] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.069448] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.069625] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.069740] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.069803] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.069947] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.070044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.070139] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.196692] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.344064] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.344257] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-134" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.344397] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-134" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.344674] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-134" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.344953] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.345469] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.345659] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.345926] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.346134] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.346972] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1305.346972] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1305.346972] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1305.346972] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1305.346972] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1305.346972] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1305.347290] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1305.367336] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1305.367580] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1305.367803] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1305.368040] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-134" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.368427] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-8e43efd0-18c3-4ad9-89ad-f4e924ef2d48 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.368657] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-8e43efd0-18c3-4ad9-89ad-f4e924ef2d48" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.368826] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-8e43efd0-18c3-4ad9-89ad-f4e924ef2d48" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.369220] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-8e43efd0-18c3-4ad9-89ad-f4e924ef2d48" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.369430] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e43efd0-18c3-4ad9-89ad-f4e924ef2d48',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.572723] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.572952] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.572952] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.573246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.573339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.573538] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.573635] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.573689] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.573821] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.573897] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.573980] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba is going to be updated. [ 1305.600495] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.600674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.600674] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.600881] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.601027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.608861] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: IN_PROGRESS for 2s [ 1305.698111] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.872096] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.872460] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.872616] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.872942] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.873215] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.873386] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 8e43efd0-18c3-4ad9-89ad-f4e924ef2d48 not found, creating... [ 1305.873670] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.873844] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.873969] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.874303] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.874463] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.874751] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.874917] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.875161] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.875408] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.875554] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.875703] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 8e43efd0-18c3-4ad9-89ad-f4e924ef2d48 is going to be created. [ 1305.895861] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.896082] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.896215] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.896488] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.896725] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.896952] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-8e43efd0-18c3-4ad9-89ad-f4e924ef2d48" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.200245] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1306.200385] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1306.914522] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.914522] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.914522] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.914522] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.933901] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1306.935029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.936302] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1306.972104] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.972251] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.972312] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.972516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.991027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.991027] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1306.991027] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1306.991027] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1307.028854] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.029019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.029086] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.029293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.030610] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.030782] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1307.101666] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.101818] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.101889] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.102668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.103055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.103473] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1307.174422] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.174561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.174639] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.174943] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.175976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.175976] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:47. [ 1307.175976] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'531bc278-c746-4ada-9fc4-704b99519eae', '92121496-4d0a-4f2f-b08f-e4603b279788', '37edbfa2-04e7-44ec-8dc2-d96aa931a0c7', '2b4e023e-3f17-4641-b235-16fa1645d85a', '19282542-923d-4b29-8ce7-e30953449122', 'd52f1e04-af0f-4b37-a85f-0fe71f26399a', '8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa', 'ebf5f404-8f48-487f-b212-72786dc389e8', '830a5dd0-aa9f-42f5-9736-1ee630ab4542', '50135ff4-8447-455b-b0a1-ca85f9b5ef55', '99092389-59da-4e36-9a78-d2e1e7edec3e', 'ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05', '39b15e36-c638-4ca0-a065-67c76e8f79fe', '64914acb-965b-4269-aaa5-676103c45a62', '2bb1158b-fef7-4aa2-82e3-14d38a93d9b2', 'cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6', '55a5191b-a436-4df6-a235-6b2c46e6eea7', '868ef973-ca6a-480b-be75-839232b752db', 'd2e65fdd-c8b6-417a-a531-e6273e09a7c2', '40991716-c8be-41b4-b8c7-a3774f7dac8e', '825fa80b-a9de-4b97-ae04-49c19c2e9faa', '839ae40b-5f13-4259-8e2a-b943b206557d', '28bbda40-40d2-4987-875c-100d45eebdba', '7fab5e96-3f01-4c71-994f-69059ca62986', 'c048f2fc-8707-43d6-b2f1-033edda0ea00', '039c805f-b0b4-4b54-b42e-9f95c1e21442', '18ff4996-ee34-4aa9-8c27-09de3d4a6f74', 'cbcf9733-e0a4-4cd5-bcff-a59904ddee14', 'ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78', 'a4e0cfba-8016-40f3-90aa-98a94645d23c', 'f1350317-f20b-48cd-9c48-1538fbce57b1', '28190eb0-e154-4896-a918-a81b5035d7b6', '41335c92-c800-4132-b9ed-f33981d30f6d', 'a9b79819-0a51-4cc6-8e3e-f823f0b89406', 'e29c3806-d806-4df2-8a52-0ecf9da87984', '67da4308-465f-4939-8941-41bacf52a39e', 'f3283394-46a2-4c04-8d8d-61fd36d02b80', 'a11f9ece-2d6a-48aa-bfa9-8e391de87f3b', 'dbe866c5-e7b8-4862-b37c-6b17f875f07e', 'e2d4f121-303e-4c6b-ac7a-e595df5750d8', '362fb317-5783-4d37-bba5-4e590ce7111d', '7d3ab8f7-3874-4370-9e84-4a90ecd908d1', 'c225ff1a-79ed-4da1-ac55-3b8ee41f70a5', '71804139-4bc8-4998-a537-3cd9da947efb', '5fa80a9f-7415-4f67-b83a-473ff443eaff', '54038215-926d-4af7-820c-4eb952c9aac0', 'b5e555cc-4bc4-4e59-b77f-deda078818fb'} {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1307.175976] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1307.194882] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.194882] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.194882] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.195167] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.195167] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.195167] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1307.195167] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1307.195301] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1307.285739] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.285993] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.286372] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.286671] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.288320] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.288731] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1307.288858] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1307.288970] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1307.289098] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1307.289242] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/47 resources of Type:Security Group Rules [ 1307.289368] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGH for action security_group_rules [ 1307.289506] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 92121496-4d0a-4f2f-b08f-e4603b279788 with Priority: HIGH for action security_group_rules [ 1307.289633] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGH for action security_group_rules [ 1307.289848] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGH for action security_group_rules [ 1307.289936] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGH for action security_group_rules [ 1307.290042] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGH for action security_group_rules [ 1307.290164] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa with Priority: HIGH for action security_group_rules [ 1307.290332] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGH for action security_group_rules [ 1307.290428] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 with Priority: HIGH for action security_group_rules [ 1307.290520] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 with Priority: HIGH for action security_group_rules [ 1307.290593] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 99092389-59da-4e36-9a78-d2e1e7edec3e with Priority: HIGH for action security_group_rules [ 1307.290646] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 with Priority: HIGH for action security_group_rules [ 1307.290711] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe with Priority: HIGH for action security_group_rules [ 1307.290763] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGH for action security_group_rules [ 1307.290826] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 with Priority: HIGH for action security_group_rules [ 1307.290880] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 with Priority: HIGH for action security_group_rules [ 1307.290938] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGH for action security_group_rules [ 1307.291024] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 868ef973-ca6a-480b-be75-839232b752db with Priority: HIGH for action security_group_rules [ 1307.291102] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 with Priority: HIGH for action security_group_rules [ 1307.291169] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e with Priority: HIGH for action security_group_rules [ 1307.291258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.385772] env[69559]: INFO networking_nsxv3.common.synchronization [req-389a2809-e7f1-4543-8ecc-1fb900382602 req-d2c96aaf-1e6f-4eca-a943-30733feef3ba service nova] Enqueued Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_rules [ 1307.385964] env[69559]: INFO networking_nsxv3.common.synchronization [req-389a2809-e7f1-4543-8ecc-1fb900382602 req-d2c96aaf-1e6f-4eca-a943-30733feef3ba service nova] Enqueued Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1307.386124] env[69559]: INFO networking_nsxv3.common.synchronization [req-389a2809-e7f1-4543-8ecc-1fb900382602 req-d2c96aaf-1e6f-4eca-a943-30733feef3ba service nova] Enqueued Resource ID: 8e43efd0-18c3-4ad9-89ad-f4e924ef2d48 with Priority: HIGHEST for action port [ 1307.386411] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_rules [ 1307.386631] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1307.386757] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e43efd0-18c3-4ad9-89ad-f4e924ef2d48 with Priority: HIGHEST for action port [ 1307.386858] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 531bc278-c746-4ada-9fc4-704b99519eae with Priority: HIGH for action security_group_rules [ 1307.386953] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 with Priority: HIGH for action security_group_rules [ 1307.387078] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa with Priority: HIGH for action security_group_rules [ 1307.387146] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 with Priority: HIGH for action security_group_rules [ 1307.387235] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e with Priority: HIGH for action security_group_rules [ 1307.387321] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 with Priority: HIGH for action security_group_rules [ 1307.387478] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 868ef973-ca6a-480b-be75-839232b752db with Priority: HIGH for action security_group_rules [ 1307.387620] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 with Priority: HIGH for action security_group_rules [ 1307.387732] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64914acb-965b-4269-aaa5-676103c45a62 with Priority: HIGH for action security_group_rules [ 1307.387824] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 with Priority: HIGH for action security_group_rules [ 1307.387912] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe with Priority: HIGH for action security_group_rules [ 1307.388009] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 with Priority: HIGH for action security_group_rules [ 1307.388099] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99092389-59da-4e36-9a78-d2e1e7edec3e with Priority: HIGH for action security_group_rules [ 1307.388190] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 with Priority: HIGH for action security_group_rules [ 1307.388265] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 with Priority: HIGH for action security_group_rules [ 1307.388350] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a with Priority: HIGH for action security_group_rules [ 1307.388434] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf5f404-8f48-487f-b212-72786dc389e8 with Priority: HIGH for action security_group_rules [ 1307.388522] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19282542-923d-4b29-8ce7-e30953449122 with Priority: HIGH for action security_group_rules [ 1307.388603] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92121496-4d0a-4f2f-b08f-e4603b279788 with Priority: HIGH for action security_group_rules [ 1307.388681] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b4e023e-3f17-4641-b235-16fa1645d85a with Priority: HIGH for action security_group_rules [ 1307.389294] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.389426] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.389493] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.389691] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.389770] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.392503] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.392597] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.392806] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e43efd0-18c3-4ad9-89ad-f4e924ef2d48 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.392985] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e43efd0-18c3-4ad9-89ad-f4e924ef2d48" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.392985] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e43efd0-18c3-4ad9-89ad-f4e924ef2d48" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.393258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e43efd0-18c3-4ad9-89ad-f4e924ef2d48" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.393322] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e43efd0-18c3-4ad9-89ad-f4e924ef2d48',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.394156] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-531bc278-c746-4ada-9fc4-704b99519eae taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.394275] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.394321] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.394551] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.394551] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('531bc278-c746-4ada-9fc4-704b99519eae',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.396029] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.396029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.396029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.396029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.396029] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37edbfa2-04e7-44ec-8dc2-d96aa931a0c7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.396718] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.396718] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.396718] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.396718] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.396718] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.397589] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.397589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.397589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.397791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.397791] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bb1158b-fef7-4aa2-82e3-14d38a93d9b2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.398492] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40991716-c8be-41b4-b8c7-a3774f7dac8e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.398607] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.398663] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.398808] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.398860] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40991716-c8be-41b4-b8c7-a3774f7dac8e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.399519] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2e65fdd-c8b6-417a-a531-e6273e09a7c2 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.399641] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.399712] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.399858] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.399930] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2e65fdd-c8b6-417a-a531-e6273e09a7c2',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.400648] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-868ef973-ca6a-480b-be75-839232b752db taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.400742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.400742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.400903] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.401113] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('868ef973-ca6a-480b-be75-839232b752db',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.401816] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55a5191b-a436-4df6-a235-6b2c46e6eea7 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.401926] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.402034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.402152] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.402277] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55a5191b-a436-4df6-a235-6b2c46e6eea7',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.402905] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64914acb-965b-4269-aaa5-676103c45a62 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.403022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.403115] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.403259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.403335] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64914acb-965b-4269-aaa5-676103c45a62',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.403994] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.404110] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.404168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.404312] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.404383] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.405062] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39b15e36-c638-4ca0-a065-67c76e8f79fe taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.405342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.405457] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.405616] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.405685] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39b15e36-c638-4ca0-a065-67c76e8f79fe',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.406467] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.406570] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.406629] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.406774] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.406846] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.407578] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99092389-59da-4e36-9a78-d2e1e7edec3e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.407645] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.407728] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.407863] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.407939] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99092389-59da-4e36-9a78-d2e1e7edec3e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.408606] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50135ff4-8447-455b-b0a1-ca85f9b5ef55 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.408931] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.408931] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.409127] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.409127] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50135ff4-8447-455b-b0a1-ca85f9b5ef55',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.409703] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.409810] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.409876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.410034] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.410108] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('830a5dd0-aa9f-42f5-9736-1ee630ab4542',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.410860] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.410969] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.411044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.411320] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.411320] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d52f1e04-af0f-4b37-a85f-0fe71f26399a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.411918] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebf5f404-8f48-487f-b212-72786dc389e8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.412119] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.412193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.412895] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.412895] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebf5f404-8f48-487f-b212-72786dc389e8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.413163] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19282542-923d-4b29-8ce7-e30953449122 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.413258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.413330] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.413477] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.413545] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19282542-923d-4b29-8ce7-e30953449122',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.414298] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92121496-4d0a-4f2f-b08f-e4603b279788 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.414404] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.414473] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.414608] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.414671] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92121496-4d0a-4f2f-b08f-e4603b279788',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.415741] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b4e023e-3f17-4641-b235-16fa1645d85a taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.416074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.416074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.416074] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.416452] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b4e023e-3f17-4641-b235-16fa1645d85a',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.437749] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.437749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.437749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.437967] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.456260] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.456406] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa is going to be deleted. [ 1307.503301] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.503301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.504029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.504029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.504029] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.504261] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c5e0e5f-5c7b-4173-8fc8-14887e73ccfa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.618305] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: SUCCESS [ 1307.618305] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba deletion is rescheduled due to dependency. [ 1307.618305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.618305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.618305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.618305] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.618305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.618781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.618781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.618781] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.618781] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.920302] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.920675] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.923689] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e43efd0-18c3-4ad9-89ad-f4e924ef2d48 with status ACTIVE [ 1307.923885] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.924096] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.924165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.924763] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.924763] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.924763] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.924971] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.924971] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.925067] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.925176] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.925705] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.925705] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.925705] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.925705] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.925705] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.926125] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e43efd0-18c3-4ad9-89ad-f4e924ef2d48 is going to be updated. [ 1307.928027] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-830a5dd0-aa9f-42f5-9736-1ee630ab4542 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.928138] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.928295] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.928360] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.928519] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.928597] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.928636] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.928800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.928905] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.928982] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.929121] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('830a5dd0-aa9f-42f5-9736-1ee630ab4542',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.978323] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.978513] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.978586] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.978814] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.993475] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.993475] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.005923] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.006137] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.006951] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.007060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.007745] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.007860] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.008918] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.009033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.009721] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.009817] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.010559] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.010670] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.011355] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.011438] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.012146] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.012231] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.012994] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.013112] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.013741] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1308.014143] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.014222] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.014791] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1308.015173] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.015320] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.015845] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1308.016235] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.016353] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.016913] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1308.017314] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.017405] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.017949] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1308.018355] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.018431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.019016] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1308.019405] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.019518] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.020108] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1308.020483] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.020572] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.021216] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1308.021633] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.021737] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55a5191b-a436-4df6-a235-6b2c46e6eea7 is going to be deleted. [ 1308.023199] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.023337] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.023399] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.023564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.023694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.023846] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e43efd0-18c3-4ad9-89ad-f4e924ef2d48" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.024011] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.024152] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.039228] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.039389] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05 is going to be deleted. [ 1308.040308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.040561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.065661] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.065804] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19282542-923d-4b29-8ce7-e30953449122 is going to be deleted. [ 1308.066745] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.066962] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.094799] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.094981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.102853] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.103105] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.106699] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.106944] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebf5f404-8f48-487f-b212-72786dc389e8 is going to be deleted. [ 1308.107966] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.108185] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.120890] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.133501] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.133501] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37edbfa2-04e7-44ec-8dc2-d96aa931a0c7 is going to be deleted. [ 1308.135198] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.135198] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.159929] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.159929] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.193961] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.194136] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.202289] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.202347] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bb1158b-fef7-4aa2-82e3-14d38a93d9b2 is going to be deleted. [ 1308.203206] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.203406] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.260876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.261077] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50135ff4-8447-455b-b0a1-ca85f9b5ef55 is going to be deleted. [ 1308.261977] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.262201] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.327108] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.327233] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.343481] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.343743] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.348210] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.348340] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 868ef973-ca6a-480b-be75-839232b752db is going to be deleted. [ 1308.349217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.349423] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.394222] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.394361] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39b15e36-c638-4ca0-a065-67c76e8f79fe is going to be deleted. [ 1308.395266] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.395574] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.433650] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.433850] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.436193] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('830a5dd0-aa9f-42f5-9736-1ee630ab4542',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.444645] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.444771] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 531bc278-c746-4ada-9fc4-704b99519eae is going to be deleted. [ 1308.445860] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.446176] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.496460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.496633] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99092389-59da-4e36-9a78-d2e1e7edec3e is going to be deleted. [ 1308.497519] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.497736] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.502951] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.503179] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.544256] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.544504] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.551040] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.551170] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92121496-4d0a-4f2f-b08f-e4603b279788 is going to be deleted. [ 1308.552180] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.552470] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.572812] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.572940] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.604833] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.605019] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d52f1e04-af0f-4b37-a85f-0fe71f26399a is going to be deleted. [ 1308.606108] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.606259] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.623027] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.651551] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.651760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.652460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.652573] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40991716-c8be-41b4-b8c7-a3774f7dac8e is going to be deleted. [ 1308.653445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.653659] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.712651] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.712858] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.734890] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.735080] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b4e023e-3f17-4641-b235-16fa1645d85a is going to be deleted. [ 1308.736076] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.736303] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.787833] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.787964] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.814080] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.814327] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.830060] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.830254] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2e65fdd-c8b6-417a-a531-e6273e09a7c2 is going to be deleted. [ 1308.831139] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.831398] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.882416] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.882621] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.928847] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.929160] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64914acb-965b-4269-aaa5-676103c45a62 is going to be deleted. [ 1308.929900] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.930122] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.938653] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 830a5dd0-aa9f-42f5-9736-1ee630ab4542: rpc.has_security_group_logging(os_id): False [ 1308.981020] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.981227] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.994547] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.994713] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6 is going to be deleted. [ 1308.995619] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.995834] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.995924] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.996061] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55a5191b-a436-4df6-a235-6b2c46e6eea7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.996224] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.996395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.996477] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.996598] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff6fb5be-83a3-4a20-b8e8-01c6e6c6ce05" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.997133] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.997311] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.997416] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.997583] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19282542-923d-4b29-8ce7-e30953449122" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.997747] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.997934] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.998056] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.998184] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebf5f404-8f48-487f-b212-72786dc389e8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.998312] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.998457] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.998640] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.998800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37edbfa2-04e7-44ec-8dc2-d96aa931a0c7" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.998931] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.999097] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.999176] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.999305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bb1158b-fef7-4aa2-82e3-14d38a93d9b2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.999454] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.999605] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.999685] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.999819] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50135ff4-8447-455b-b0a1-ca85f9b5ef55" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.999970] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.000132] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.000209] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.000320] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-868ef973-ca6a-480b-be75-839232b752db" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.000445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.000769] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.000769] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.000769] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-531bc278-c746-4ada-9fc4-704b99519eae" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.000952] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.001127] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.001237] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.001392] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39b15e36-c638-4ca0-a065-67c76e8f79fe" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.001527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.001668] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.001742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.001854] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99092389-59da-4e36-9a78-d2e1e7edec3e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.001976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.002126] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.002201] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.002306] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92121496-4d0a-4f2f-b08f-e4603b279788" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.002449] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.002610] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.002684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.002795] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d52f1e04-af0f-4b37-a85f-0fe71f26399a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.002916] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.003186] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.003305] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.003388] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40991716-c8be-41b4-b8c7-a3774f7dac8e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.003514] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.003701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.003755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.003825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b4e023e-3f17-4641-b235-16fa1645d85a" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.003948] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.004187] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.024724] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.024912] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.040575] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.040827] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.040983] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.040983] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.041222] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.041301] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.041386] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 is going to be updated. [ 1309.042398] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.042568] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.042646] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.042760] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2e65fdd-c8b6-417a-a531-e6273e09a7c2" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.126051] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.126051] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.126051] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.126051] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.126051] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.126051] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba is going to be updated. [ 1309.144847] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.145068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.145068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.145273] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.145355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.145512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb33e2a4-7dc0-4a91-b8b7-801e5164ecd6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.146314] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.146462] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.146559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.146643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.146712] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.146821] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64914acb-965b-4269-aaa5-676103c45a62" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.173952] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.174147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.174147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.174379] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.174580] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.183208] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: IN_PROGRESS for 2s [ 1309.209423] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1309.210122] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.210299] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.210400] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.210686] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.210862] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.246241] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 in Status: IN_PROGRESS for 2s [ 1310.354562] env[69559]: INFO networking_nsxv3.common.synchronization [req-e0b02447-c50a-41bf-9c1f-09cde5a3e701 req-2df25678-cd8a-49f3-9916-bca950718847 tempest-AttachVolumeTestJSON-949454441 tempest-AttachVolumeTestJSON-949454441-project-member] Enqueued Resource ID: f1350317-f20b-48cd-9c48-1538fbce57b1 with Priority: HIGHEST for action security_group_members [ 1310.354857] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1350317-f20b-48cd-9c48-1538fbce57b1 with Priority: HIGHEST for action security_group_members [ 1310.354911] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1350317-f20b-48cd-9c48-1538fbce57b1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.355883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.355883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.355883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.355883] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.355883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.355883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.355883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.355883] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.356286] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1350317-f20b-48cd-9c48-1538fbce57b1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.862250] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.862549] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.862625] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.862833] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.884101] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.884101] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.884101] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.884417] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.884417] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.884500] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.884576] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1350317-f20b-48cd-9c48-1538fbce57b1 is going to be updated. [ 1310.908560] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.908824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.908824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.909031] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.909173] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.916997] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1350317-f20b-48cd-9c48-1538fbce57b1 in Status: IN_PROGRESS for 2s [ 1311.193828] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: SUCCESS [ 1311.194116] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.194303] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.194552] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.194762] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.194884] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.194963] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.195135] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.195258] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.195334] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.195446] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.266211] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 in Status: SUCCESS [ 1311.266463] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.698220] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.698623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.698623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.698711] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.698889] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.699038] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.699120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.699339] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.699477] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.699603] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.699803] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.699944] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.700047] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.700250] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.700435] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.700561] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.700643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.700814] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.700899] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.700986] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.701142] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.204019] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28bbda40-40d2-4987-875c-100d45eebdba: rpc.has_security_group_logging(os_id): False [ 1312.222416] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.222643] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.222768] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.223130] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.243214] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.243549] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.243680] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.243748] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.243958] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.244072] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.244288] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.244407] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.244471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.244672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.244755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.244949] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.245057] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.245124] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.245293] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.245371] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.245475] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28bbda40-40d2-4987-875c-100d45eebdba is going to be updated. [ 1312.305807] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.306078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.306078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.306341] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.306507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.320958] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: IN_PROGRESS for 2s [ 1312.926627] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1350317-f20b-48cd-9c48-1538fbce57b1 in Status: SUCCESS [ 1312.927108] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1350317-f20b-48cd-9c48-1538fbce57b1 deletion is rescheduled due to dependency. [ 1312.927255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.337350] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: SUCCESS [ 1314.337734] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.356162] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1315.356573] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1319.057973] env[69559]: INFO networking_nsxv3.common.synchronization [req-3aedc9fb-a2dd-4398-ac2e-a0284eaafa96 req-25714712-e24b-42ec-9bad-b8610ad99eae tempest-ServerDiskConfigTestJSON-722175017 tempest-ServerDiskConfigTestJSON-722175017-project-member] Enqueued Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1319.058598] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGHEST for action security_group_members [ 1319.058922] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.060171] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.060302] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.060487] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.060659] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.060770] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.060972] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.061200] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.061328] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.061430] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.565048] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.565048] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.565048] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.565048] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.565048] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.565401] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.565401] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.565401] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.565534] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.565627] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.565759] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba is going to be updated. [ 1319.593720] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.593873] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.593918] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.594086] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.594217] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.603142] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: IN_PROGRESS for 2s [ 1321.613913] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28bbda40-40d2-4987-875c-100d45eebdba in Status: SUCCESS [ 1321.614379] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28bbda40-40d2-4987-875c-100d45eebdba deletion is rescheduled due to dependency. [ 1321.614379] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.059802] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1324.060100] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1329.061405] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1329.061703] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1329.242973] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-946 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.243214] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-946" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.243413] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-946" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.243699] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-946" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.243973] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.244163] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.244320] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.244629] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.244784] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.244999] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1329.245132] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1329.245247] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1329.245393] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1329.245534] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1329.245649] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1329.245789] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1329.265027] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1329.265170] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1329.265313] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1329.265480] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-946" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.265750] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-b6eeecef-4a97-457e-9d4c-396bd1513672 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.265915] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-b6eeecef-4a97-457e-9d4c-396bd1513672" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.266053] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-b6eeecef-4a97-457e-9d4c-396bd1513672" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.266285] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-b6eeecef-4a97-457e-9d4c-396bd1513672" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.266434] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6eeecef-4a97-457e-9d4c-396bd1513672',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.768397] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.768647] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.768767] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.769066] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.769225] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.769518] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.769683] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.769805] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.770037] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.770185] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.770468] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.770629] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.770748] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.770958] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.771111] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.771273] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: b6eeecef-4a97-457e-9d4c-396bd1513672 is going to be updated. [ 1329.791505] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.791685] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.791814] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.792051] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.792240] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.792466] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-b6eeecef-4a97-457e-9d4c-396bd1513672" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.667783] env[69559]: INFO networking_nsxv3.common.synchronization [req-b447367f-2ed1-4f75-9da5-2ab26003166b req-57482866-00c9-4793-ab3d-d2bc6429b2e5 service nova] Enqueued Resource ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 with Priority: HIGHEST for action security_group_rules [ 1330.668088] env[69559]: INFO networking_nsxv3.common.synchronization [req-b447367f-2ed1-4f75-9da5-2ab26003166b req-57482866-00c9-4793-ab3d-d2bc6429b2e5 service nova] Enqueued Resource ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 with Priority: HIGHEST for action security_group_members [ 1330.668187] env[69559]: INFO networking_nsxv3.common.synchronization [req-b447367f-2ed1-4f75-9da5-2ab26003166b req-57482866-00c9-4793-ab3d-d2bc6429b2e5 service nova] Enqueued Resource ID: b6eeecef-4a97-457e-9d4c-396bd1513672 with Priority: HIGHEST for action port [ 1330.668337] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 with Priority: HIGHEST for action security_group_rules [ 1330.668462] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 with Priority: HIGHEST for action security_group_members [ 1330.668561] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6eeecef-4a97-457e-9d4c-396bd1513672 with Priority: HIGHEST for action port [ 1330.669118] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.669271] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.669311] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.669492] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.669574] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('830a5dd0-aa9f-42f5-9736-1ee630ab4542',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.670361] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-830a5dd0-aa9f-42f5-9736-1ee630ab4542 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.670470] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.670536] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.670697] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.670838] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.670932] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.671032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.671147] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.671226] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.671316] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('830a5dd0-aa9f-42f5-9736-1ee630ab4542',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.672360] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6eeecef-4a97-457e-9d4c-396bd1513672 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.672481] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6eeecef-4a97-457e-9d4c-396bd1513672" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.672556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6eeecef-4a97-457e-9d4c-396bd1513672" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.672667] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6eeecef-4a97-457e-9d4c-396bd1513672" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.672739] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6eeecef-4a97-457e-9d4c-396bd1513672',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.174753] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-830a5dd0-aa9f-42f5-9736-1ee630ab4542 taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.174965] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.175027] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('830a5dd0-aa9f-42f5-9736-1ee630ab4542',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.175940] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6eeecef-4a97-457e-9d4c-396bd1513672 with status ACTIVE [ 1331.176126] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.176242] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.176308] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.176512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.176604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.176772] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.176867] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.176927] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.177092] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.177168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.177347] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.177440] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.177501] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.177636] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.177710] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.177792] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6eeecef-4a97-457e-9d4c-396bd1513672 is going to be updated. [ 1331.197546] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.197742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.197742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.197898] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.198037] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.198239] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6eeecef-4a97-457e-9d4c-396bd1513672" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.679734] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('830a5dd0-aa9f-42f5-9736-1ee630ab4542',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.182176] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.182468] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.182573] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.182823] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.182953] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.183098] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 is going to be updated. [ 1332.214222] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.214453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.214516] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.214727] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.214923] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.223315] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 in Status: IN_PROGRESS for 2s [ 1334.234432] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 in Status: SUCCESS [ 1334.234909] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.234909] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.235055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.235215] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.235336] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.235395] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.235552] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.235636] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.235726] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.235821] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('830a5dd0-aa9f-42f5-9736-1ee630ab4542',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.738758] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('830a5dd0-aa9f-42f5-9736-1ee630ab4542',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.241682] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 830a5dd0-aa9f-42f5-9736-1ee630ab4542: rpc.has_security_group_logging(os_id): False [ 1335.259359] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.259550] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.259838] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.259965] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.259965] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.260741] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.260741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.260741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.260741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.260741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.260741] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 is going to be updated. [ 1335.323115] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.323373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.323373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.323566] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.323708] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.333440] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 in Status: IN_PROGRESS for 2s [ 1335.669570] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.669773] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1337.349157] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 in Status: SUCCESS [ 1337.349574] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.671440] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.671892] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1345.672639] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.672990] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1350.673941] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1350.674358] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1355.675127] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1355.675571] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1357.138492] env[69559]: INFO networking_nsxv3.common.synchronization [None req-3d4cfa61-07f7-4938-af5b-b0e80893b800 tempest-ServerActionsTestJSON-823938086 tempest-ServerActionsTestJSON-823938086-project-member] Enqueued Resource ID: a9fd23b4-fe94-40df-8000-970c4ef481fd with Priority: HIGHEST for action security_group_rules [ 1357.139016] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9fd23b4-fe94-40df-8000-970c4ef481fd with Priority: HIGHEST for action security_group_rules [ 1357.139322] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9fd23b4-fe94-40df-8000-970c4ef481fd taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.139441] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.139507] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.139758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.139841] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9fd23b4-fe94-40df-8000-970c4ef481fd',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.200656] env[69559]: INFO networking_nsxv3.common.synchronization [None req-4fd04d88-5e2f-47e0-b173-9e152849cfbc tempest-ServerActionsTestJSON-823938086 tempest-ServerActionsTestJSON-823938086-project-member] Enqueued Resource ID: a9fd23b4-fe94-40df-8000-970c4ef481fd with Priority: HIGHEST for action security_group_rules [ 1357.200826] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9fd23b4-fe94-40df-8000-970c4ef481fd with Priority: HIGHEST for action security_group_rules [ 1357.201358] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9fd23b4-fe94-40df-8000-970c4ef481fd taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.201665] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.659762] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.659989] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.660103] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.660373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.660496] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.660626] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9fd23b4-fe94-40df-8000-970c4ef481fd already deleted. [ 1357.660742] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.660937] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.661165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.661280] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9fd23b4-fe94-40df-8000-970c4ef481fd',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.180991] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.181390] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.181390] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.181390] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.181612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.181612] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9fd23b4-fe94-40df-8000-970c4ef481fd already deleted. [ 1358.181612] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.202289] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1362.202589] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1362.310619] env[69559]: INFO networking_nsxv3.common.synchronization [req-8cb1b342-d0d3-46d8-8bdc-0f14917bd45c req-90ff5561-e3dd-4996-9f28-8492db0b9bec tempest-ServerActionsTestJSON-823938086 tempest-ServerActionsTestJSON-823938086-project-member] Enqueued Resource ID: a9fd23b4-fe94-40df-8000-970c4ef481fd with Priority: HIGHEST for action security_group_members [ 1362.311079] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9fd23b4-fe94-40df-8000-970c4ef481fd with Priority: HIGHEST for action security_group_members [ 1362.311388] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9fd23b4-fe94-40df-8000-970c4ef481fd taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.312094] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.312177] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.312428] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.312642] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.312708] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.312749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.312896] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.312981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.313086] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9fd23b4-fe94-40df-8000-970c4ef481fd',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.563180] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.563317] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-978" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.563397] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-978" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.563704] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-978" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.563972] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.564173] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.564298] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.564700] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.564700] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.564876] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1362.564998] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1362.565140] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1362.565256] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1362.565372] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1362.565481] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1362.565617] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1362.584856] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1362.585069] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1362.585201] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1362.585400] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-978" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.585675] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-4b12a1f4-dea6-4f63-aac6-90eb26452005 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.585842] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-4b12a1f4-dea6-4f63-aac6-90eb26452005" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.586847] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-4b12a1f4-dea6-4f63-aac6-90eb26452005" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.586847] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-4b12a1f4-dea6-4f63-aac6-90eb26452005" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.586847] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b12a1f4-dea6-4f63-aac6-90eb26452005',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.815687] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.815927] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.815927] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.816141] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.816234] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.816427] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.816527] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.816589] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.816739] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.816816] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.816942] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9fd23b4-fe94-40df-8000-970c4ef481fd already deleted. [ 1362.817055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.089320] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.089981] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.089981] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.090158] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.090576] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.090576] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 4b12a1f4-dea6-4f63-aac6-90eb26452005 not found, creating... [ 1363.091139] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.091240] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.091425] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.091750] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.091836] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.092146] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.092378] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.092521] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.092744] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.093563] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.093819] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 4b12a1f4-dea6-4f63-aac6-90eb26452005 is going to be created. [ 1363.113158] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.113348] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.113469] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.113787] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.114036] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.114271] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-4b12a1f4-dea6-4f63-aac6-90eb26452005" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.783880] env[69559]: INFO networking_nsxv3.common.synchronization [req-8cb1b342-d0d3-46d8-8bdc-0f14917bd45c req-b03db3d4-13c2-40ff-94ef-a34cea0584fb service nova] Enqueued Resource ID: a9fd23b4-fe94-40df-8000-970c4ef481fd with Priority: HIGHEST for action security_group_rules [ 1363.784163] env[69559]: INFO networking_nsxv3.common.synchronization [req-8cb1b342-d0d3-46d8-8bdc-0f14917bd45c req-b03db3d4-13c2-40ff-94ef-a34cea0584fb service nova] Enqueued Resource ID: a9fd23b4-fe94-40df-8000-970c4ef481fd with Priority: HIGHEST for action security_group_members [ 1363.784255] env[69559]: INFO networking_nsxv3.common.synchronization [req-8cb1b342-d0d3-46d8-8bdc-0f14917bd45c req-b03db3d4-13c2-40ff-94ef-a34cea0584fb service nova] Enqueued Resource ID: 4b12a1f4-dea6-4f63-aac6-90eb26452005 with Priority: HIGHEST for action port [ 1363.784446] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9fd23b4-fe94-40df-8000-970c4ef481fd with Priority: HIGHEST for action security_group_rules [ 1363.784583] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9fd23b4-fe94-40df-8000-970c4ef481fd with Priority: HIGHEST for action security_group_members [ 1363.784709] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b12a1f4-dea6-4f63-aac6-90eb26452005 with Priority: HIGHEST for action port [ 1363.785266] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9fd23b4-fe94-40df-8000-970c4ef481fd taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.785399] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.785469] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.785667] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.785750] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9fd23b4-fe94-40df-8000-970c4ef481fd',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.786547] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9fd23b4-fe94-40df-8000-970c4ef481fd taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.786654] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.786722] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.786880] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.787035] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.787132] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.787193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.787330] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.787411] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.787496] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9fd23b4-fe94-40df-8000-970c4ef481fd',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.789776] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b12a1f4-dea6-4f63-aac6-90eb26452005 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.789889] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b12a1f4-dea6-4f63-aac6-90eb26452005" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.789955] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b12a1f4-dea6-4f63-aac6-90eb26452005" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.790114] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b12a1f4-dea6-4f63-aac6-90eb26452005" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.790377] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b12a1f4-dea6-4f63-aac6-90eb26452005',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.291515] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9fd23b4-fe94-40df-8000-970c4ef481fd',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.292918] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9fd23b4-fe94-40df-8000-970c4ef481fd taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.293040] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.293392] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b12a1f4-dea6-4f63-aac6-90eb26452005 with status ACTIVE [ 1364.293553] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.293695] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.293755] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.293956] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.294055] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.294220] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.294314] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.294376] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.294520] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.294604] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.294815] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.294919] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.294961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.295093] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.295166] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.295248] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b12a1f4-dea6-4f63-aac6-90eb26452005 is going to be updated. [ 1364.314742] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.314885] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.314936] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.315084] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.315208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.315354] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b12a1f4-dea6-4f63-aac6-90eb26452005" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.795494] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9fd23b4-fe94-40df-8000-970c4ef481fd',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.297903] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.298097] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.298152] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.298349] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.298439] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.298535] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9fd23b4-fe94-40df-8000-970c4ef481fd is going to be created. [ 1365.327070] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.327227] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.327283] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.327486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.327637] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.337362] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9fd23b4-fe94-40df-8000-970c4ef481fd in Status: UNINITIALIZED for 2s [ 1367.347435] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9fd23b4-fe94-40df-8000-970c4ef481fd in Status: SUCCESS [ 1367.347851] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.347851] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.347999] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.348202] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.348314] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.348374] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.348529] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.348611] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.348699] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.348790] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9fd23b4-fe94-40df-8000-970c4ef481fd',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.851308] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9fd23b4-fe94-40df-8000-970c4ef481fd',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.353528] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9fd23b4-fe94-40df-8000-970c4ef481fd: rpc.has_security_group_logging(os_id): False [ 1368.369583] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.369724] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.369806] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.370028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.370123] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.370358] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.370459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.370521] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.370667] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.370741] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.370857] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9fd23b4-fe94-40df-8000-970c4ef481fd is going to be created. [ 1368.423766] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.423898] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.423990] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.424158] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.424325] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.433744] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9fd23b4-fe94-40df-8000-970c4ef481fd in Status: IN_PROGRESS for 2s [ 1368.785872] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1368.785872] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1370.446498] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9fd23b4-fe94-40df-8000-970c4ef481fd in Status: SUCCESS [ 1370.446942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.786989] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1373.787317] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1378.788426] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1378.788798] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1381.625441] env[69559]: INFO networking_nsxv3.common.synchronization [req-991641e5-0149-43ac-901c-562e1471c123 req-af6fbc7d-6d41-4d0a-8c84-adffdcc2fc27 tempest-AttachVolumeShelveTestJSON-1912655505 tempest-AttachVolumeShelveTestJSON-1912655505-project-member] Enqueued Resource ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 with Priority: HIGHEST for action security_group_members [ 1381.626054] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 with Priority: HIGHEST for action security_group_members [ 1381.626367] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-830a5dd0-aa9f-42f5-9736-1ee630ab4542 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.626487] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.626550] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.626747] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.626901] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.627010] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.627077] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.627220] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.627304] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.627394] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('830a5dd0-aa9f-42f5-9736-1ee630ab4542',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.130017] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.130230] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.130230] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.130485] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.130618] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.130867] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.130993] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.131071] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.131247] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.131364] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.131500] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 is going to be updated. [ 1382.162079] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.162229] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.162274] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.162459] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.162651] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.171370] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 in Status: IN_PROGRESS for 2s [ 1384.182076] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 in Status: SUCCESS [ 1384.182469] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 830a5dd0-aa9f-42f5-9736-1ee630ab4542 deletion is rescheduled due to dependency. [ 1384.182469] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-830a5dd0-aa9f-42f5-9736-1ee630ab4542" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.627038] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1386.627436] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1391.628322] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1391.628322] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1396.629447] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1396.629447] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1401.630819] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1401.630819] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1406.631675] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1406.632072] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1411.632413] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1411.632775] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1416.633508] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1416.633927] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1421.634280] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1421.634599] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1426.636541] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1426.636935] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1431.637720] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1431.638314] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1436.638794] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1436.639204] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1441.640313] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1441.640756] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1446.641667] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1446.642132] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1451.643110] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1451.643479] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1454.524518] env[69559]: INFO networking_nsxv3.common.synchronization [req-e8e24637-87b3-49d6-9da6-96b6562b6dca req-6b16749d-1e7c-4fa1-b1a9-454f575675d4 tempest-ServerActionsTestJSON-823938086 tempest-ServerActionsTestJSON-823938086-project-member] Enqueued Resource ID: a9fd23b4-fe94-40df-8000-970c4ef481fd with Priority: HIGHEST for action security_group_members [ 1454.525045] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9fd23b4-fe94-40df-8000-970c4ef481fd with Priority: HIGHEST for action security_group_members [ 1454.525354] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9fd23b4-fe94-40df-8000-970c4ef481fd taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.525484] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.525575] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.525752] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.525903] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.526019] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.526075] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.526235] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.526361] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.526481] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9fd23b4-fe94-40df-8000-970c4ef481fd',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1455.028475] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.028707] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.028707] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.028870] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.028960] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.029169] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.029261] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.029320] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.029463] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.029538] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.029640] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9fd23b4-fe94-40df-8000-970c4ef481fd is going to be updated. [ 1455.062242] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1455.062433] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1455.062433] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1455.062587] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1455.062721] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1455.071580] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9fd23b4-fe94-40df-8000-970c4ef481fd in Status: IN_PROGRESS for 2s [ 1457.082641] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9fd23b4-fe94-40df-8000-970c4ef481fd in Status: SUCCESS [ 1457.083032] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9fd23b4-fe94-40df-8000-970c4ef481fd deletion is rescheduled due to dependency. [ 1457.083032] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9fd23b4-fe94-40df-8000-970c4ef481fd" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.525693] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1459.526048] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1464.526746] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1464.527137] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1469.528177] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1469.528541] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1474.529611] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1474.529611] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1479.530685] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1479.531039] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1484.531889] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1484.532293] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1487.512367] env[69559]: INFO networking_nsxv3.common.synchronization [req-fb23f84b-b803-4bdc-96cb-0ea8ecff80ac req-b528d1fd-2045-4fbe-8fd1-db1c982c96ef tempest-ServerActionsTestJSON-823938086 tempest-ServerActionsTestJSON-823938086-project-member] Enqueued Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_members [ 1487.512367] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_members [ 1487.512367] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-41335c92-c800-4132-b9ed-f33981d30f6d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.512367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.512367] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.512844] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.512844] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.512933] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.512933] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.513083] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.513180] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.513438] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.016548] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.016791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.016791] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.016987] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.037226] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.037467] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.037583] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.037649] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.037831] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.037913] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.038035] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41335c92-c800-4132-b9ed-f33981d30f6d is going to be updated. [ 1488.063451] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.063623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.063623] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.063803] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.063936] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.071539] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: IN_PROGRESS for 2s [ 1490.082186] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: SUCCESS [ 1490.082605] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41335c92-c800-4132-b9ed-f33981d30f6d deletion is rescheduled due to dependency. [ 1490.082605] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.513295] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1492.513600] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1494.314859] env[69559]: INFO networking_nsxv3.common.synchronization [req-267b74b0-98fb-4a32-973e-cd5449e5c278 req-aa47178d-ddc1-4df7-8195-1caa0dddad42 tempest-ServerActionsTestJSON-823938086 tempest-ServerActionsTestJSON-823938086-project-member] Enqueued Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_members [ 1494.315445] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_members [ 1494.315756] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-41335c92-c800-4132-b9ed-f33981d30f6d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.315899] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.315974] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.316224] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.316327] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.316425] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.316486] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.316624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.316721] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.316814] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1494.568214] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.568214] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-978" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.568214] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-978" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.568214] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-978" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.568214] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.568538] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.568538] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.568911] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.568911] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.569305] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1494.569439] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1494.569564] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1494.569687] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1494.569806] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1494.569955] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1494.570078] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1494.590244] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1494.590415] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1494.590596] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1494.590767] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-978" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.591067] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-76465bbf-4355-4ce4-9a26-0360d0a7583e taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.591245] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-76465bbf-4355-4ce4-9a26-0360d0a7583e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.591372] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-76465bbf-4355-4ce4-9a26-0360d0a7583e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.591670] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-76465bbf-4355-4ce4-9a26-0360d0a7583e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.591815] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76465bbf-4355-4ce4-9a26-0360d0a7583e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1494.819442] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.819654] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.819654] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.819845] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.819938] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.820118] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.820216] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.820275] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.820417] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.820492] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.820577] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41335c92-c800-4132-b9ed-f33981d30f6d is going to be updated. [ 1494.843503] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.843707] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.843707] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.843839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.843961] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.852726] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: IN_PROGRESS for 2s [ 1495.094538] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.094741] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.094858] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.095220] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.095384] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.095547] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 76465bbf-4355-4ce4-9a26-0360d0a7583e not found, creating... [ 1495.095813] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.095997] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.096607] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.096607] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.096607] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.096769] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.096925] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.097060] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.097275] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.097414] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.097559] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 76465bbf-4355-4ce4-9a26-0360d0a7583e is going to be created. [ 1495.117622] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.117789] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.117899] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.118158] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.118387] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.118609] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-76465bbf-4355-4ce4-9a26-0360d0a7583e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1495.780576] env[69559]: INFO networking_nsxv3.common.synchronization [req-267b74b0-98fb-4a32-973e-cd5449e5c278 req-a4fae261-8863-406c-a877-1753f6bc77a0 service nova] Enqueued Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_rules [ 1495.780840] env[69559]: INFO networking_nsxv3.common.synchronization [req-267b74b0-98fb-4a32-973e-cd5449e5c278 req-a4fae261-8863-406c-a877-1753f6bc77a0 service nova] Enqueued Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_members [ 1495.780902] env[69559]: INFO networking_nsxv3.common.synchronization [req-267b74b0-98fb-4a32-973e-cd5449e5c278 req-a4fae261-8863-406c-a877-1753f6bc77a0 service nova] Enqueued Resource ID: 76465bbf-4355-4ce4-9a26-0360d0a7583e with Priority: HIGHEST for action port [ 1495.781148] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_rules [ 1495.781276] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_members [ 1495.781367] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76465bbf-4355-4ce4-9a26-0360d0a7583e with Priority: HIGHEST for action port [ 1495.781885] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41335c92-c800-4132-b9ed-f33981d30f6d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.782047] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.782120] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.782331] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.782411] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1495.783243] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-41335c92-c800-4132-b9ed-f33981d30f6d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.783300] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.783483] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-76465bbf-4355-4ce4-9a26-0360d0a7583e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1495.783581] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76465bbf-4355-4ce4-9a26-0360d0a7583e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1495.783647] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76465bbf-4355-4ce4-9a26-0360d0a7583e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1495.783802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76465bbf-4355-4ce4-9a26-0360d0a7583e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1495.783875] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76465bbf-4355-4ce4-9a26-0360d0a7583e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1496.286078] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-41335c92-c800-4132-b9ed-f33981d30f6d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.286078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.286281] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 76465bbf-4355-4ce4-9a26-0360d0a7583e with status ACTIVE [ 1496.286331] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.286460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.286506] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.286723] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.286780] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.286932] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.287044] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.287099] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.287254] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.287329] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.287514] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.287607] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.287667] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.287802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.287875] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.287958] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 76465bbf-4355-4ce4-9a26-0360d0a7583e is going to be updated. [ 1496.308298] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.308454] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.308505] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.308626] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.308747] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.308889] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76465bbf-4355-4ce4-9a26-0360d0a7583e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.861400] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: SUCCESS [ 1496.861694] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41335c92-c800-4132-b9ed-f33981d30f6d deletion is rescheduled due to dependency. [ 1496.861694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.861826] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.862039] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.862245] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.862419] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.862493] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.862830] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.862830] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.862830] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1497.364843] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1497.866675] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1498.368858] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.369022] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.369097] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.369316] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.369408] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.369504] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41335c92-c800-4132-b9ed-f33981d30f6d is going to be updated. [ 1498.396163] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1498.396343] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1498.396391] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1498.396553] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1498.396687] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1498.404758] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: IN_PROGRESS for 2s [ 1500.414622] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: SUCCESS [ 1500.414992] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.415068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.415298] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.415518] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.415650] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.415733] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.415922] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.416053] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.416175] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1500.416288] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1500.782792] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1500.783025] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1500.918249] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.420645] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 41335c92-c800-4132-b9ed-f33981d30f6d: rpc.has_security_group_logging(os_id): False [ 1501.437304] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.437531] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.437531] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.437701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.437794] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.438053] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.438167] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.438208] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.438355] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.438431] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.438515] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41335c92-c800-4132-b9ed-f33981d30f6d is going to be updated. [ 1501.500360] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1501.500541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1501.500541] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1501.500717] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1501.500849] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.512246] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: IN_PROGRESS for 2s [ 1503.525117] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: SUCCESS [ 1503.525460] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1505.784083] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1505.784519] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1510.785452] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1510.785846] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1515.786146] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1515.786615] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1520.787797] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1520.788201] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1525.788863] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1525.789249] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1529.734523] env[69559]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1529.734871] env[69559]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-22723a8e-06d1-4ff9-899c-e5c7af878146 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1530.790441] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1530.790807] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1535.791389] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1535.791826] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1540.792284] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1540.792625] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1544.692509] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1544.692976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1544.692976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1544.692976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1544.693129] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.196170] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.698874] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.793286] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1545.793470] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1546.201051] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1546.201259] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1546.987116] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.987590] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.987590] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.987590] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.000175] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1547.000980] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.001725] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1547.043333] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.043512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.043512] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.043703] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.057313] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.058063] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1547.058143] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1547.058230] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1547.091643] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.091802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.091852] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.092058] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.092722] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.092871] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1547.165953] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.166157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.166157] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.166353] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.166630] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.166887] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1547.235664] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.235862] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.235907] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.236087] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.236368] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.236646] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:29. [ 1547.236742] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'825fa80b-a9de-4b97-ae04-49c19c2e9faa', '839ae40b-5f13-4259-8e2a-b943b206557d', '28bbda40-40d2-4987-875c-100d45eebdba', '7fab5e96-3f01-4c71-994f-69059ca62986', 'c048f2fc-8707-43d6-b2f1-033edda0ea00', '039c805f-b0b4-4b54-b42e-9f95c1e21442', '18ff4996-ee34-4aa9-8c27-09de3d4a6f74', 'cbcf9733-e0a4-4cd5-bcff-a59904ddee14', 'ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78', 'a4e0cfba-8016-40f3-90aa-98a94645d23c', 'f1350317-f20b-48cd-9c48-1538fbce57b1', '28190eb0-e154-4896-a918-a81b5035d7b6', '41335c92-c800-4132-b9ed-f33981d30f6d', 'a9b79819-0a51-4cc6-8e3e-f823f0b89406', 'e29c3806-d806-4df2-8a52-0ecf9da87984', '67da4308-465f-4939-8941-41bacf52a39e', 'f3283394-46a2-4c04-8d8d-61fd36d02b80', 'a11f9ece-2d6a-48aa-bfa9-8e391de87f3b', 'dbe866c5-e7b8-4862-b37c-6b17f875f07e', 'e2d4f121-303e-4c6b-ac7a-e595df5750d8', '362fb317-5783-4d37-bba5-4e590ce7111d', '830a5dd0-aa9f-42f5-9736-1ee630ab4542', '7d3ab8f7-3874-4370-9e84-4a90ecd908d1', 'a9fd23b4-fe94-40df-8000-970c4ef481fd', 'c225ff1a-79ed-4da1-ac55-3b8ee41f70a5', '71804139-4bc8-4998-a537-3cd9da947efb', '5fa80a9f-7415-4f67-b83a-473ff443eaff', '54038215-926d-4af7-820c-4eb952c9aac0', 'b5e555cc-4bc4-4e59-b77f-deda078818fb'} {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1547.236857] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1547.253320] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.253519] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.253519] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.253654] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.253732] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.253832] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1547.253903] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1547.253965] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1547.329110] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.329329] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.329329] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.329525] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.330706] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1547.330968] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1547.331059] env[69559]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69559) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1547.331122] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1547.331183] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1547.331260] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/29 resources of Type:Security Group Rules [ 1547.331324] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa with Priority: HIGH for action security_group_rules [ 1547.331404] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGH for action security_group_rules [ 1547.331469] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGH for action security_group_rules [ 1547.331526] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGH for action security_group_rules [ 1547.331583] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 with Priority: HIGH for action security_group_rules [ 1547.331639] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 with Priority: HIGH for action security_group_rules [ 1547.331691] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 with Priority: HIGH for action security_group_rules [ 1547.331773] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGH for action security_group_rules [ 1547.331870] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 with Priority: HIGH for action security_group_rules [ 1547.331941] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a4e0cfba-8016-40f3-90aa-98a94645d23c with Priority: HIGH for action security_group_rules [ 1547.331997] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f1350317-f20b-48cd-9c48-1538fbce57b1 with Priority: HIGH for action security_group_rules [ 1547.332082] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 28190eb0-e154-4896-a918-a81b5035d7b6 with Priority: HIGH for action security_group_rules [ 1547.332131] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGH for action security_group_rules [ 1547.332191] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGH for action security_group_rules [ 1547.332245] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e29c3806-d806-4df2-8a52-0ecf9da87984 with Priority: HIGH for action security_group_rules [ 1547.332293] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 67da4308-465f-4939-8941-41bacf52a39e with Priority: HIGH for action security_group_rules [ 1547.332348] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 with Priority: HIGH for action security_group_rules [ 1547.332410] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b with Priority: HIGH for action security_group_rules [ 1547.332752] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGH for action security_group_rules [ 1547.332752] env[69559]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 with Priority: HIGH for action security_group_rules [ 1547.332752] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.794123] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1550.794560] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1550.794560] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa with Priority: HIGH for action security_group_rules [ 1550.794560] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28bbda40-40d2-4987-875c-100d45eebdba with Priority: HIGH for action security_group_rules [ 1550.794560] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 with Priority: HIGH for action security_group_rules [ 1550.794746] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e29c3806-d806-4df2-8a52-0ecf9da87984 with Priority: HIGH for action security_group_rules [ 1550.794746] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 with Priority: HIGH for action security_group_rules [ 1550.794837] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e with Priority: HIGH for action security_group_rules [ 1550.794916] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b with Priority: HIGH for action security_group_rules [ 1550.795017] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 with Priority: HIGH for action security_group_rules [ 1550.795081] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 with Priority: HIGH for action security_group_rules [ 1550.795146] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67da4308-465f-4939-8941-41bacf52a39e with Priority: HIGH for action security_group_rules [ 1550.795232] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGH for action security_group_rules [ 1550.795319] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28190eb0-e154-4896-a918-a81b5035d7b6 with Priority: HIGH for action security_group_rules [ 1550.795433] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1350317-f20b-48cd-9c48-1538fbce57b1 with Priority: HIGH for action security_group_rules [ 1550.795519] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4e0cfba-8016-40f3-90aa-98a94645d23c with Priority: HIGH for action security_group_rules [ 1550.795576] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 with Priority: HIGH for action security_group_rules [ 1550.795652] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 with Priority: HIGH for action security_group_rules [ 1550.795740] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 with Priority: HIGH for action security_group_rules [ 1550.795826] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 with Priority: HIGH for action security_group_rules [ 1550.795910] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 839ae40b-5f13-4259-8e2a-b943b206557d with Priority: HIGH for action security_group_rules [ 1550.795993] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fab5e96-3f01-4c71-994f-69059ca62986 with Priority: HIGH for action security_group_rules [ 1550.796345] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-825fa80b-a9de-4b97-ae04-49c19c2e9faa taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.796498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.796565] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.796776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.796858] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('825fa80b-a9de-4b97-ae04-49c19c2e9faa',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.798056] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28bbda40-40d2-4987-875c-100d45eebdba taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.798181] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.798249] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.798419] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.798495] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28bbda40-40d2-4987-875c-100d45eebdba',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.799248] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18ff4996-ee34-4aa9-8c27-09de3d4a6f74 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.799345] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.799419] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.799556] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.799627] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18ff4996-ee34-4aa9-8c27-09de3d4a6f74',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.800314] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e29c3806-d806-4df2-8a52-0ecf9da87984 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.800454] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.800524] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.801159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.801159] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e29c3806-d806-4df2-8a52-0ecf9da87984',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.801523] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2d4f121-303e-4c6b-ac7a-e595df5750d8 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.801680] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.801680] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.801876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.801948] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2d4f121-303e-4c6b-ac7a-e595df5750d8',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.803138] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.803138] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.803138] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.803283] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.803362] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbe866c5-e7b8-4862-b37c-6b17f875f07e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.806123] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.806246] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.806307] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.806572] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.806670] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a11f9ece-2d6a-48aa-bfa9-8e391de87f3b',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.807463] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3283394-46a2-4c04-8d8d-61fd36d02b80 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.807594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.807663] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.807815] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.807920] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3283394-46a2-4c04-8d8d-61fd36d02b80',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.809018] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9b79819-0a51-4cc6-8e3e-f823f0b89406 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.809244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.809318] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.809451] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.809528] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9b79819-0a51-4cc6-8e3e-f823f0b89406',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.810528] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67da4308-465f-4939-8941-41bacf52a39e taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.810656] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.810733] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.810969] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.811050] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67da4308-465f-4939-8941-41bacf52a39e',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.812159] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41335c92-c800-4132-b9ed-f33981d30f6d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.812159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.812159] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.812441] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.812537] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.813342] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28190eb0-e154-4896-a918-a81b5035d7b6 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.813501] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.813501] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.813672] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.813795] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28190eb0-e154-4896-a918-a81b5035d7b6',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.814453] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1350317-f20b-48cd-9c48-1538fbce57b1 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.814609] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.814720] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.814820] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.814924] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1350317-f20b-48cd-9c48-1538fbce57b1',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.815565] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4e0cfba-8016-40f3-90aa-98a94645d23c taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.815733] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.815733] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.815943] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.815943] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4e0cfba-8016-40f3-90aa-98a94645d23c',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.816691] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.816843] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.816843] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.816992] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.817079] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.817701] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-039c805f-b0b4-4b54-b42e-9f95c1e21442 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.817846] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.817925] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.818064] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.818178] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('039c805f-b0b4-4b54-b42e-9f95c1e21442',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.818777] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbcf9733-e0a4-4cd5-bcff-a59904ddee14 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.818942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.818942] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.819312] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.819312] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbcf9733-e0a4-4cd5-bcff-a59904ddee14',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.819870] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c048f2fc-8707-43d6-b2f1-033edda0ea00 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.820056] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.820056] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.820275] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.820275] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c048f2fc-8707-43d6-b2f1-033edda0ea00',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.821273] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-839ae40b-5f13-4259-8e2a-b943b206557d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.821413] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.821498] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.821642] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.821642] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('839ae40b-5f13-4259-8e2a-b943b206557d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.822579] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fab5e96-3f01-4c71-994f-69059ca62986 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.822729] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.822729] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.822979] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.822979] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fab5e96-3f01-4c71-994f-69059ca62986',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.845185] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.845362] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.845362] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.845587] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.862348] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.862499] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18ff4996-ee34-4aa9-8c27-09de3d4a6f74 is going to be deleted. [ 1550.911185] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.911382] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.911382] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.911545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.911640] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.911758] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18ff4996-ee34-4aa9-8c27-09de3d4a6f74" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.331476] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-41335c92-c800-4132-b9ed-f33981d30f6d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.331723] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.331723] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.331876] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.332051] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.332155] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.332222] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.332363] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.332445] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.332533] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.332617] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.341305] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.341433] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.341506] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.341639] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.347854] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.347963] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.392227] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.392441] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.393153] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.393255] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.393965] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.394085] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.394769] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.394874] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.395582] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.395701] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.396386] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.396529] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.397229] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.397321] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.398088] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.398188] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.398845] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.398957] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.399603] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.399712] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.400308] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1551.400707] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.400795] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.401547] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1551.401935] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.402042] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.402677] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1551.403067] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.403200] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9b79819-0a51-4cc6-8e3e-f823f0b89406 is going to be deleted. [ 1551.404649] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.404743] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.404814] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.404997] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.406349] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.406452] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.407033] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1551.407433] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.407528] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.408193] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1551.408588] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.408683] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.429691] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1551.430097] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.430210] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e29c3806-d806-4df2-8a52-0ecf9da87984 is going to be deleted. [ 1551.430976] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.431180] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.450559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.450681] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 825fa80b-a9de-4b97-ae04-49c19c2e9faa is going to be deleted. [ 1551.451393] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.451622] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.472568] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.472718] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.473969] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.474145] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c048f2fc-8707-43d6-b2f1-033edda0ea00 is going to be deleted. [ 1551.474854] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.475050] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.476951] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.477068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.491714] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.491889] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78 is going to be deleted. [ 1551.492693] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.492879] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.512752] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.512851] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4e0cfba-8016-40f3-90aa-98a94645d23c is going to be deleted. [ 1551.513595] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.513774] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.530107] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.530268] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.531347] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.531493] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.535284] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.535458] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a11f9ece-2d6a-48aa-bfa9-8e391de87f3b is going to be deleted. [ 1551.536559] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.536825] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.582510] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.582678] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1350317-f20b-48cd-9c48-1538fbce57b1 is going to be deleted. [ 1551.584068] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.584373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.599228] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.599385] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.609358] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.609540] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.641078] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.641324] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28190eb0-e154-4896-a918-a81b5035d7b6 is going to be deleted. [ 1551.642509] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.642908] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.644706] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.644848] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.679203] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.679338] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 839ae40b-5f13-4259-8e2a-b943b206557d is going to be deleted. [ 1551.680346] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.680555] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.682578] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.682691] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.763043] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.763043] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 039c805f-b0b4-4b54-b42e-9f95c1e21442 is going to be deleted. [ 1551.763611] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.763827] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.845166] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.845571] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.848616] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1551.861065] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.861226] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbcf9733-e0a4-4cd5-bcff-a59904ddee14 is going to be deleted. [ 1551.861973] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.862245] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.863935] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.864079] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.895073] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.895304] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28bbda40-40d2-4987-875c-100d45eebdba is going to be deleted. [ 1551.896170] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.896394] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.934847] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.935169] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.935836] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.958851] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fab5e96-3f01-4c71-994f-69059ca62986 is going to be deleted. [ 1551.958851] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.958851] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.966343] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.966692] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.012763] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.012939] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67da4308-465f-4939-8941-41bacf52a39e is going to be deleted. [ 1552.013889] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.014168] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.055557] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.055730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.064824] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.065015] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2d4f121-303e-4c6b-ac7a-e595df5750d8 is going to be deleted. [ 1552.065965] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.066193] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.081161] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.081327] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.132489] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.132659] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbe866c5-e7b8-4862-b37c-6b17f875f07e is going to be deleted. [ 1552.133564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.133830] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.192955] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.193174] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.202113] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.202240] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3283394-46a2-4c04-8d8d-61fd36d02b80 is going to be deleted. [ 1552.203155] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.203379] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.203496] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.203641] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9b79819-0a51-4cc6-8e3e-f823f0b89406" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.203770] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.203928] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.204016] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.204131] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e29c3806-d806-4df2-8a52-0ecf9da87984" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.204607] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.204768] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.204848] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.204967] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c048f2fc-8707-43d6-b2f1-033edda0ea00" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.205108] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.205247] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.205321] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.205466] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-825fa80b-a9de-4b97-ae04-49c19c2e9faa" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.205593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.205731] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.205804] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.205972] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4e0cfba-8016-40f3-90aa-98a94645d23c" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.206119] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.206264] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.206338] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.206453] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea36cdaf-2ec8-421f-a67a-30ffbc6dcb78" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.206579] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.206714] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.206785] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.206892] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a11f9ece-2d6a-48aa-bfa9-8e391de87f3b" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.207028] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.207166] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.207238] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.207350] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1350317-f20b-48cd-9c48-1538fbce57b1" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.207470] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.207607] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.207679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.207782] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28190eb0-e154-4896-a918-a81b5035d7b6" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.207902] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.208045] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.208117] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.208256] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-839ae40b-5f13-4259-8e2a-b943b206557d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.208449] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.208614] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.208691] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.208800] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-039c805f-b0b4-4b54-b42e-9f95c1e21442" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.208946] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.209092] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.209229] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.209326] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbcf9733-e0a4-4cd5-bcff-a59904ddee14" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.209383] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.209517] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.209588] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.209694] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28bbda40-40d2-4987-875c-100d45eebdba" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.209833] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.209971] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.210058] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.210161] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fab5e96-3f01-4c71-994f-69059ca62986" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.210915] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.211033] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.211100] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.211247] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.211323] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.211477] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2d4f121-303e-4c6b-ac7a-e595df5750d8" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.211549] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.211715] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.211792] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.211900] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67da4308-465f-4939-8941-41bacf52a39e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.256378] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.256564] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.256600] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.256793] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.256881] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.256996] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbe866c5-e7b8-4862-b37c-6b17f875f07e" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.293217] env[69559]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1552.293856] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.294052] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.294160] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.294414] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.294521] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.294650] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3283394-46a2-4c04-8d8d-61fd36d02b80" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.351237] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 41335c92-c800-4132-b9ed-f33981d30f6d: rpc.has_security_group_logging(os_id): False [ 1552.381353] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.381624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.381624] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.381788] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.411867] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.412206] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.412336] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.412387] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.412599] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.412681] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.412772] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41335c92-c800-4132-b9ed-f33981d30f6d is going to be updated. [ 1552.496875] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.497103] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.497103] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.497265] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.497409] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.510771] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: IN_PROGRESS for 2s [ 1554.524880] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: SUCCESS [ 1554.525280] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1555.797072] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1555.797495] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1560.797855] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1560.798157] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1565.798813] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1565.799211] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1570.800425] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1570.800686] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1575.666713] env[69559]: INFO networking_nsxv3.common.synchronization [req-17a7aaae-7c46-467c-9f48-d96b0cec0f8c req-9007d138-593b-4a60-8212-b944bb4e7a6e tempest-ServerActionsTestJSON-823938086 tempest-ServerActionsTestJSON-823938086-project-member] Enqueued Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_members [ 1575.667263] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_members [ 1575.667593] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-41335c92-c800-4132-b9ed-f33981d30f6d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1575.667720] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1575.667785] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1575.667986] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1575.668157] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1575.668257] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1575.668316] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1575.668464] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1575.668572] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1575.668643] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1576.170423] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1576.170593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1576.170593] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1576.170817] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1576.170910] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1576.171125] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1576.171231] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1576.171278] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1576.171422] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1576.171495] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1576.171579] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41335c92-c800-4132-b9ed-f33981d30f6d is going to be updated. [ 1576.199049] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1576.199188] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1576.199220] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1576.199390] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1576.199513] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1576.206689] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: IN_PROGRESS for 2s [ 1578.217407] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: SUCCESS [ 1578.217678] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41335c92-c800-4132-b9ed-f33981d30f6d deletion is rescheduled due to dependency. [ 1578.217678] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.668160] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1580.668620] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1582.534679] env[69559]: INFO networking_nsxv3.common.synchronization [req-9fc21be8-547e-4717-a1b6-16693fc046a3 req-1dfc5c47-c8c5-4931-8dbe-b3c39b9559fa tempest-ServerActionsTestJSON-823938086 tempest-ServerActionsTestJSON-823938086-project-member] Enqueued Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_members [ 1582.535211] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_members [ 1582.535516] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-41335c92-c800-4132-b9ed-f33981d30f6d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.535666] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.535730] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.535913] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.536081] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.536182] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.536244] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.536386] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.536469] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1582.536560] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.009062] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.009215] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "network-978" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.009215] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "network-978" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.009484] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "network-978" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.009749] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.009912] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.010046] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.010266] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.010419] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.010656] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1583.010775] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] NeedRegenerationException {{(pid=69559) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1583.010890] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] no value, waiting for create lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1583.011010] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] value creation lock acquired {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1583.011131] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] No value present for key: 'zone-id' {{(pid=69559) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1583.011241] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Calling creation function for not-yet-present value {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1583.011377] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1583.031061] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1583.031202] env[69559]: DEBUG dogpile.cache.region [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69559) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1583.031355] env[69559]: DEBUG dogpile.lock [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Released creation lock {{(pid=69559) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1583.031531] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "network-978" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.031810] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock port-2772f7b1-73ad-4241-b126-708345795dd0 taken with stack trace [, , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.031979] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "port-2772f7b1-73ad-4241-b126-708345795dd0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.032118] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "port-2772f7b1-73ad-4241-b126-708345795dd0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.032422] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "port-2772f7b1-73ad-4241-b126-708345795dd0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.032568] env[69559]: DEBUG networking_nsxv3.api.rpc [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2772f7b1-73ad-4241-b126-708345795dd0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1583.038041] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.038186] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.038257] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.038424] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.038510] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.038686] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.038783] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.038844] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.038982] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.039071] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.039154] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41335c92-c800-4132-b9ed-f33981d30f6d is going to be updated. [ 1583.061919] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.062082] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.062142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.062346] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.062480] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.070049] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: IN_PROGRESS for 2s [ 1583.534454] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.534698] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.534971] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.535111] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.535277] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.535438] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Segment Port 2772f7b1-73ad-4241-b126-708345795dd0 not found, creating... [ 1583.535735] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.535912] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.536056] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.536292] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.536441] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.536753] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.536932] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.537072] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.537295] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.537435] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.537584] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Resource: SegmentPort with ID: 2772f7b1-73ad-4241-b126-708345795dd0 is going to be created. [ 1583.557213] env[69559]: DEBUG networking_nsxv3.common.locking [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1583.557479] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1583.557695] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1583.558031] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1583.558394] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1583.558723] env[69559]: DEBUG oslo_concurrency.lockutils [None req-3eb37aa9-3dab-43b3-8493-b98c3cd41a55 None None] Releasing lock "port-2772f7b1-73ad-4241-b126-708345795dd0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.217182] env[69559]: INFO networking_nsxv3.common.synchronization [req-9fc21be8-547e-4717-a1b6-16693fc046a3 req-51dc1fe6-a355-4b8a-b4c6-8cb96ebe63ef service nova] Enqueued Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_rules [ 1584.217363] env[69559]: INFO networking_nsxv3.common.synchronization [req-9fc21be8-547e-4717-a1b6-16693fc046a3 req-51dc1fe6-a355-4b8a-b4c6-8cb96ebe63ef service nova] Enqueued Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_members [ 1584.217574] env[69559]: INFO networking_nsxv3.common.synchronization [req-9fc21be8-547e-4717-a1b6-16693fc046a3 req-51dc1fe6-a355-4b8a-b4c6-8cb96ebe63ef service nova] Enqueued Resource ID: 2772f7b1-73ad-4241-b126-708345795dd0 with Priority: HIGHEST for action port [ 1584.217804] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_rules [ 1584.217931] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_members [ 1584.218124] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2772f7b1-73ad-4241-b126-708345795dd0 with Priority: HIGHEST for action port [ 1584.218577] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41335c92-c800-4132-b9ed-f33981d30f6d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.218708] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.218778] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.218972] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.219062] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1584.220690] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-41335c92-c800-4132-b9ed-f33981d30f6d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.220690] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.220690] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock port-2772f7b1-73ad-4241-b126-708345795dd0 taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.220690] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2772f7b1-73ad-4241-b126-708345795dd0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.220690] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2772f7b1-73ad-4241-b126-708345795dd0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.220690] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2772f7b1-73ad-4241-b126-708345795dd0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.220690] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2772f7b1-73ad-4241-b126-708345795dd0',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1584.722082] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2772f7b1-73ad-4241-b126-708345795dd0 with status ACTIVE [ 1584.722387] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.722461] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.722572] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.722720] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.722809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.722985] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.723142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.723142] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.723288] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.723358] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.723535] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.723617] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.723679] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.723809] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.723881] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.723961] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2772f7b1-73ad-4241-b126-708345795dd0 is going to be updated. [ 1584.725113] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-41335c92-c800-4132-b9ed-f33981d30f6d taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.725206] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.744114] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.744285] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.744285] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.744471] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.744596] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.744743] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2772f7b1-73ad-4241-b126-708345795dd0" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.078822] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: SUCCESS [ 1585.078995] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41335c92-c800-4132-b9ed-f33981d30f6d deletion is rescheduled due to dependency. [ 1585.079114] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.079269] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.079475] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.079656] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.079771] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.079833] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.079979] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.080069] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.080163] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1585.582547] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1586.084593] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1586.587310] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.587479] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.587594] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.587749] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.587838] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.587936] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41335c92-c800-4132-b9ed-f33981d30f6d is going to be updated. [ 1586.612277] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.612424] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.612424] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.612619] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.612753] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.619914] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: IN_PROGRESS for 2s [ 1588.629782] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: SUCCESS [ 1588.630059] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.630165] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.630373] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.630566] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1588.630678] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1588.630743] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1588.630899] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1588.630981] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.631075] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1588.631166] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1589.133156] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1589.218710] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1589.218877] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1589.635216] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 41335c92-c800-4132-b9ed-f33981d30f6d: rpc.has_security_group_logging(os_id): False [ 1589.651905] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.652056] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.652130] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.652343] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.652434] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.652677] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.652776] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.652839] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.652984] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.653075] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.653159] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41335c92-c800-4132-b9ed-f33981d30f6d is going to be updated. [ 1589.708051] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1589.708051] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1589.708051] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1589.708300] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1589.708300] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1589.721787] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: IN_PROGRESS for 2s [ 1591.736525] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: SUCCESS [ 1591.736802] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1594.220191] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1594.220505] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1599.221247] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1599.221584] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1604.222922] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1604.223274] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1609.223799] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1609.224181] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1614.225574] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1614.225957] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1619.227205] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1619.227553] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1624.228797] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1624.229182] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1629.229732] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1629.230130] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1634.230745] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1634.231092] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1639.231905] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1639.232280] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1644.233068] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1644.233433] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1646.002850] env[69559]: INFO networking_nsxv3.common.synchronization [req-dcda45ca-7a31-4eec-a073-18a42c3d29cc req-7a30c7f6-e635-4a96-a7cd-a7bbadeec54e tempest-ServerActionsTestJSON-823938086 tempest-ServerActionsTestJSON-823938086-project-member] Enqueued Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_members [ 1646.003651] env[69559]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41335c92-c800-4132-b9ed-f33981d30f6d with Priority: HIGHEST for action security_group_members [ 1646.003732] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock member-41335c92-c800-4132-b9ed-f33981d30f6d taken with stack trace [, , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1646.003818] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1646.003882] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1646.004342] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1646.004504] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1646.004626] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1646.004684] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1646.004843] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1646.004956] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1646.005019] env[69559]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41335c92-c800-4132-b9ed-f33981d30f6d',) {} {{(pid=69559) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1646.507043] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1646.507236] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1646.507280] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1646.507586] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1646.507644] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1646.507852] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1646.507952] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1646.508027] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1646.508171] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1646.508248] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1646.508340] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41335c92-c800-4132-b9ed-f33981d30f6d is going to be updated. [ 1646.543417] env[69559]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69559) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1646.543545] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1646.543578] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1646.543747] env[69559]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1646.543868] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1646.551311] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: IN_PROGRESS for 2s [ 1648.561726] env[69559]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41335c92-c800-4132-b9ed-f33981d30f6d in Status: SUCCESS [ 1648.562137] env[69559]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41335c92-c800-4132-b9ed-f33981d30f6d deletion is rescheduled due to dependency. [ 1648.562137] env[69559]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41335c92-c800-4132-b9ed-f33981d30f6d" {{(pid=69559) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1651.004878] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1651.005280] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1656.005588] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1656.005859] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1661.006389] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1661.006787] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1666.007683] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1666.007950] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1671.008861] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1671.009242] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1676.010372] env[69559]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1676.010642] env[69559]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0